Apr 10 13:11:27 devstack cinder-volume[72819]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 13:11:27 devstack cinder-volume[72819]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 13:11:27 devstack cinder-volume[72819]: we strongly recommend against using it for new projects. Apr 10 13:11:27 devstack cinder-volume[72819]: If you are already using Eventlet, we recommend migrating to a different Apr 10 13:11:27 devstack cinder-volume[72819]: framework. For more detail see Apr 10 13:11:27 devstack cinder-volume[72819]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 13:11:27 devstack cinder-volume[72819]: import eventlet # noqa Apr 10 13:11:29 devstack cinder-volume[72819]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 13:11:29 devstack cinder-volume[72819]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 13:11:29 devstack cinder-volume[72819]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 13:11:29 devstack cinder-volume[72819]: INFO dbcounter [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Registered counter for database cinder Apr 10 13:11:29 devstack cinder-volume[72819]: DEBUG oslo_db.sqlalchemy.engines [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:11:29 devstack cinder-volume[72819]: DEBUG dbcounter [-] [72819] Writer thread running {{(pid=72819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 13:11:29 devstack cinder-volume[72819]: INFO cinder.rpc [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 13:11:29 devstack cinder-volume[72819]: INFO cinder.rpc [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 13:11:29 devstack cinder-volume[72819]: DEBUG oslo_db.sqlalchemy.engines [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:11:30 devstack cinder-volume[72819]: INFO cinder.volume.manager [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Determined volume DB was empty at startup. Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG cinder.volume.manager [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72819) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 13:11:30 devstack cinder-volume[72819]: INFO cinder.volume.manager [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 13:11:30 devstack cinder-volume[72819]: WARNING stevedore.named [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 13:11:30 devstack cinder-volume[72819]: WARNING castellan.key_manager [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 13:11:30 devstack cinder-volume[72819]: WARNING cinder.keymgr.conf_key_mgr [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG cinder.volume.drivers.lvm [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72819) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_concurrency.processutils [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_concurrency.processutils [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] CMD "cinder-rtstool verify" returned: 0 in 0.220s {{(pid=72819) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_db.sqlalchemy.engines [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:11:30 devstack cinder-volume[72819]: INFO cinder.rpc [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 10 13:11:30 devstack cinder-volume[72819]: INFO cinder.rpc [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 10 13:11:30 devstack cinder-volume[72819]: WARNING stevedore.named [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 13:11:30 devstack cinder-volume[72819]: WARNING castellan.key_manager [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 13:11:30 devstack cinder-volume[72819]: INFO cinder.volume.manager [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_db.sqlalchemy.engines [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:11:30 devstack cinder-volume[72819]: INFO oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Starting 1 workers Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Started child 72927 {{(pid=72819) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Full set of CONF: {{(pid=72819) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] ******************************************************************************** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Configuration options gathered from: {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] ================================================================================ {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 13:11:30 devstack cinder-volume[72927]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] allow_availability_zone_fallback = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] allow_compression_on_image_upload = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] allowed_direct_url_schemes = [] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] api_rate_limit = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] auth_strategy = keystone {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] az_cache_duration = 3600 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_availability_zone = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_host = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_name = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_stats_polling_interval = 60 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backup_api_class = cinder.backup.api.API {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backup_name_template = backup-%s {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backup_use_same_host = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backup_use_temp_snapshot = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] chap_password = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] chap_username = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cinder_internal_tenant_project_id = b3caf7197e3944d88e5a1a80893bbdf9 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cinder_internal_tenant_user_id = 62a53aab17164da4a077965e24aae63e {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cloned_volume_same_az = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cluster = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] compression_format = gzip {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] compute_api_class = cinder.compute.nova.API {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] config_dir = [] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] config_source = [] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] control_exchange = openstack {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] debug = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] default_availability_zone = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] default_group_type = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] default_volume_type = lvmdriver-1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] disk_geometry = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] driver_client_cert = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] driver_client_cert_key = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] driver_data_namespace = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] driver_ssl_cert_path = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] driver_ssl_cert_verify = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] driver_use_ssl = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] enable_force_upload = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] enable_new_services = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] enable_unsupported_driver = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] enabled_backends = ['lvmdriver-1'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] enforce_multipath_for_image_xfer = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] filter_function = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance_api_insecure = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance_api_servers = ['http://192.168.122.241/image'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance_api_ssl_compression = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance_ca_certificates_file = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance_catalog_info = image:glance:publicURL {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance_certfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance_keyfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance_num_retries = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance_request_timeout = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] goodness_function = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] graceful_shutdown_timeout = 5 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] group_api_class = cinder.group.api.API {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] host = devstack {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] image_compress_on_upload = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72927]: INFO cinder.volume.manager [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] image_conversion_address_space_limit = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] image_conversion_cpu_limit = 60 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] image_conversion_disable = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] image_upload_use_cinder_backend = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] image_upload_use_internal_tenant = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] image_volume_cache_enabled = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] image_volume_cache_max_count = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] image_volume_cache_max_size_gb = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] init_host_max_objects_retrieval = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] instance_format = [instance: %(uuid)s] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] iscsi_target_flags = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] iscsi_write_cache = on {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] iser_helper = tgtadm {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] iser_ip_address = 192.168.122.241 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] iser_port = 3260 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] log_color = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] log_config_append = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] log_dir = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] log_file = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] log_options = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] log_rotate_interval = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] log_rotate_interval_type = days {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] log_rotation_type = none {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] max_age = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] max_logfile_count = 30 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] max_logfile_size_mb = 200 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] max_over_subscription_ratio = 20.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] message_reap_interval = 86400 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] message_ttl = 2592000 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] migration_create_volume_timeout_secs = 300 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] monkey_patch = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] monkey_patch_modules = [] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] my_ip = 192.168.122.241 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] no_snapshot_gb_quota = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] num_iser_scan_tries = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] num_shell_tries = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] num_volume_device_scan_tries = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] nvmeof_conn_info_version = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] nvmet_ns_id = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] nvmet_port_id = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] osapi_max_limit = 1000 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] osapi_volume_ext_list = [] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] osapi_volume_listen = 0.0.0.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] osapi_volume_listen_port = 8776 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] osapi_volume_use_ssl = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] osapi_volume_workers = 2 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] per_volume_size_limit = -1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] periodic_fuzzy_delay = 60 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] periodic_interval = 60 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] project_id_regex = [0-9a-f\-]+ {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] public_endpoint = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] publish_errors = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] quota_backup_gigabytes = 1000 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] quota_backups = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] quota_gigabytes = 1000 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] quota_groups = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] quota_snapshots = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] quota_volumes = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] rate_limit_burst = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] rate_limit_except_level = CRITICAL {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] rate_limit_interval = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] reinit_driver_count = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] replication_device = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] report_discard_supported = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] report_interval = 120 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] reservation_clean_interval = 86400 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] reservation_expire = 86400 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] reserved_image_namespaces = [] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] reserved_percentage = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] rpc_response_timeout = 120 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] run_external_periodic_tasks = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] scst_target_driver = iscsi {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] scst_target_iqn_name = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_down_time = 720 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] shell_completion = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] snapshot_name_template = snapshot-%s {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] snapshot_same_host = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] split_loggers = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] state_path = /opt/stack/data/cinder {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] storage_availability_zone = nova {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] storage_protocol = iSCSI {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] syslog_log_facility = LOG_USER {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] target_helper = lioadm {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] target_ip_address = 192.168.122.241 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] target_port = 3260 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] target_protocol = iscsi {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] target_secondary_ip_addresses = [] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] trace_flags = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] transfer_api_class = cinder.transfer.api.API {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] transport_url = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] until_refresh = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] use_chap_auth = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] use_default_quota_class = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] use_journal = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] use_json = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] use_multipath_for_image_xfer = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] use_stderr = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] use_syslog = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] verify_glance_signatures = enabled {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_api_class = cinder.volume.api.API {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_backend_name = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_clear = zero {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_clear_ionice = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_clear_size = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_copy_bps_limit = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_dd_blocksize = 1M {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_name_template = volume-%s {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_service_inithost_offload = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volume_usage_audit_period = month {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] zoning_mode = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_concurrency.disable_process_locking = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.admin_password = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.admin_token = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.admin_user = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.auth_admin_prefix = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.auth_port = 35357 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.auth_protocol = https {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.auth_section = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.auth_type = password {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.auth_uri = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.auth_version = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.cache = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.certfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.delay_auth_decision = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.http_connect_timeout = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.identity_uri = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.include_service_catalog = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.insecure = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.interface = public {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.keyfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_password = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcache_username = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.region_name = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.service_token_roles_required = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.service_type = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.token_cache_time = 300 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.241/identity {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.backend = dogpile.cache.null {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.backend_argument = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.backend_expiration_time = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.config_prefix = cache.oslo {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.debug_cache_backend = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.enable_retry_client = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.enable_socket_keepalive = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.enabled = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.enforce_fips_mode = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.expiration_time = 600 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.hashclient_retry_attempts = 2 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.memcache_dead_retry = 300 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.memcache_pool_maxsize = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.memcache_sasl_enabled = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.password = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.proxies = [] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.redis_db = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.redis_sentinel_service_name = mymaster {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.redis_server = localhost:6379 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.retry_attempts = 2 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.retry_delay = 0.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.socket_keepalive_count = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.socket_keepalive_idle = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.socket_keepalive_interval = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.socket_timeout = 1.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.tls_allowed_ciphers = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.tls_cafile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.tls_certfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.tls_enabled = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.tls_keyfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cache.username = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] coordination.backend_url = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.asyncio_connection = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.asyncio_slave_connection = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.backend = sqlalchemy {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.connection = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.connection_debug = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.connection_parameters = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.connection_recycle_time = 3600 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.connection_trace = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.db_inc_retry_interval = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.db_max_retries = 20 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.db_max_retry_interval = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.db_retry_interval = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.max_overflow = 50 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.max_pool_size = 5 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.max_retries = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.mysql_wsrep_sync_wait = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.pool_timeout = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.retry_interval = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.slave_connection = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.sqlite_synchronous = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.synchronous_reader = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] database.use_db_reconnect = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:30 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.connection_string = messaging:// {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.enabled = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.es_doc_type = notification {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.es_scroll_size = 10000 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.es_scroll_time = 2m {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.filter_error_trace = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.hmac_keys = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.sentinel_service_name = mymaster {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.socket_timeout = 0.1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack sudo[72931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 10 13:11:30 devstack sudo[72931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.trace_requests = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler.trace_sqlalchemy = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler_jaeger.process_tags = {} {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler_jaeger.service_name_prefix = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] profiler_otlp.service_name_prefix = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.enforce_new_defaults = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: WARNING oslo_config.cfg [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.enforce_scope = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.policy_default_rule = default {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.policy_file = policy.yaml {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_policy.remote_timeout = 60.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] privsep_osbrick.group = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] privsep_osbrick.helper_command = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] privsep_osbrick.user = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cinder_sys_admin.group = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cinder_sys_admin.helper_command = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] cinder_sys_admin.user = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_user.auth_section = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_user.auth_type = password {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_user.cafile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_user.certfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_user.collect_timing = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_user.insecure = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_user.keyfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_user.send_service_user_token = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_user.split_loggers = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] service_user.timeout = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance.auth_section = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance.auth_type = password {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance.certfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance.collect_timing = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance.insecure = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance.keyfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance.region_name = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance.split_loggers = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] glance.timeout = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.backend_availability_zone = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.chap_password = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.chap_username = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.disk_geometry = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.driver_client_cert = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.driver_client_cert_key = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.driver_data_namespace = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.driver_use_ssl = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.enable_unsupported_driver = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.extra_capabilities = {} {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.filter_function = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.goodness_function = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.iscsi_target_flags = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.iscsi_write_cache = on {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.iser_helper = tgtadm {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.iser_ip_address = 192.168.122.241 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.iser_port = 3260 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.lvm_mirrors = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.lvm_share_target = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.lvm_type = auto {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.num_shell_tries = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.nvmet_port_id = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.replication_device = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.report_discard_supported = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.reserved_percentage = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.scst_target_driver = iscsi {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.scst_target_iqn_name = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.storage_protocol = iSCSI {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.target_helper = tgtadm {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.target_ip_address = 192.168.122.241 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.target_port = 3260 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.target_protocol = iscsi {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.trace_flags = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.unique_fqdn_network = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.use_chap_auth = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.volume_backend_name = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.volume_clear = zero {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.volume_clear_ionice = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.volume_clear_size = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.volume_group = cinder-volumes {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_reports.file_event_handler = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_reports.log_dir = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.backend_availability_zone = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.backend_host = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.chap_password = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.chap_username = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.chiscsi_conf = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.disk_geometry = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.driver_client_cert = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.driver_data_namespace = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.driver_use_ssl = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.extra_capabilities = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.filter_function = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.goodness_function = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.iser_helper = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.iser_ip_address = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.iser_port = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.iser_target_prefix = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.lvm_conf_file = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.lvm_mirrors = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.lvm_share_target = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.lvm_type = auto {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.num_shell_tries = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.nvmet_port_id = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.replication_device = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.report_discard_supported = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.reserved_percentage = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.scst_target_driver = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.storage_protocol = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.target_helper = lioadm {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.target_ip_address = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.target_port = 3260 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.target_protocol = iscsi {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.trace_flags = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.use_chap_auth = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.volume_clear = zero {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.volume_clear_size = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] lvmdriver-1.volumes_dir = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.ssl = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.ssl_version = {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_notifications.driver = [] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_notifications.retry = -1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] oslo_messaging_notifications.transport_url = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] key_manager.fixed_key = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.barbican_api_version = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.barbican_endpoint = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.barbican_endpoint_type = public {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.barbican_region_name = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.cafile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.certfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.collect_timing = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.insecure = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.keyfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.number_of_retries = 60 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.retry_delay = 1 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.send_service_user_token = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.split_loggers = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.timeout = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.verify_ssl = True {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican.verify_ssl_path = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican_service_user.auth_section = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican_service_user.auth_type = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican_service_user.cafile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican_service_user.certfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican_service_user.collect_timing = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican_service_user.insecure = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican_service_user.keyfile = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican_service_user.split_loggers = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] barbican_service_user.timeout = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.approle_role_id = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.approle_secret_id = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.kv_mountpoint = secret {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.kv_path = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.kv_version = 2 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.namespace = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.root_token_id = **** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.ssl_ca_crt_file = None {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.timeout = 60.0 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.use_ssl = False {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:11:30 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] ******************************************************************************** {{(pid=72819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 13:11:31 devstack sudo[72931]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:31 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:31 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:31 devstack sudo[73003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:11:31 devstack sudo[73003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:31 devstack sudo[73003]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:31 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.530s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:31 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:11:31 devstack cinder-volume[72927]: INFO cinder.brick.local_dev.lvm [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 10 13:11:31 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:31 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:31 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:31 devstack sudo[73237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 13:11:31 devstack sudo[73237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:32 devstack sudo[73237]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:32 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.537s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:32 devstack cinder-volume[72927]: DEBUG cinder.brick.local_dev.lvm [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72927) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 10 13:11:32 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:32 devstack sudo[73428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:11:32 devstack sudo[73428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:33 devstack sudo[73428]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:33 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.951s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:33 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:33 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:33 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:33 devstack sudo[73594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:11:33 devstack sudo[73594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:33 devstack sudo[73594]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:33 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:33 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:33 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:33 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:33 devstack sudo[73628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 10 13:11:33 devstack sudo[73628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:34 devstack sudo[73628]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:34 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.565s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:34 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:34 devstack sudo[73665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 13:11:34 devstack sudo[73665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:34 devstack sudo[73665]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:34 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:34 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:34 devstack sudo[73670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 13:11:34 devstack sudo[73670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:35 devstack sudo[73670]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:35 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:35 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:35 devstack sudo[73676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:11:35 devstack sudo[73676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:35 devstack sudo[73676]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:35 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:35 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:35 devstack sudo[73681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:11:35 devstack sudo[73681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:35 devstack sudo[73681]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:35 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.437s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:35 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:35 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:35 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:35 devstack sudo[73685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:11:35 devstack sudo[73685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:36 devstack sudo[73685]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:36 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:36 devstack cinder-volume[72927]: INFO cinder.volume.drivers.lvm [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 10 13:11:36 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:36 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:36 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:36 devstack sudo[73695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:11:36 devstack sudo[73695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:36 devstack sudo[73695]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:36 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:36 devstack cinder-volume[72927]: DEBUG cinder.volume.drivers.lvm [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Updating volume stats {{(pid=72927) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 13:11:36 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:36 devstack sudo[73808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 13:11:36 devstack sudo[73808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:37 devstack sudo[73808]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:37 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:37 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:37 devstack sudo[73885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:11:37 devstack sudo[73885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:37 devstack sudo[73885]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:37 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:37 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:37 devstack sudo[73953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:11:37 devstack sudo[73953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:38 devstack sudo[73953]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:38 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:38 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:38 devstack sudo[73956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:11:38 devstack sudo[73956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:38 devstack sudo[73956]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:38 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:38 devstack cinder-volume[72927]: INFO cinder.volume.driver [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Driver hasn't implemented _init_vendor_properties() Apr 10 13:11:38 devstack cinder-volume[72927]: DEBUG cinder.volume.driver [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72927) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 13:11:38 devstack cinder-volume[72927]: DEBUG oslo_db.sqlalchemy.engines [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72927) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:11:38 devstack cinder-volume[72927]: DEBUG dbcounter [-] [72927] Writer thread running {{(pid=72927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 13:11:38 devstack cinder-volume[72927]: DEBUG cinder.db.sqlalchemy.api [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Building query based on filter {{(pid=72927) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 13:11:38 devstack cinder-volume[72927]: DEBUG cinder.image.image_utils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72927) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 13:11:38 devstack cinder-volume[72927]: INFO cinder.keymgr.migration [None req-da25be1e-0634-4faa-99c2-f8a86f1bfa50 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 13:11:38 devstack cinder-volume[72927]: DEBUG cinder.volume.drivers.lvm [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Updating volume stats {{(pid=72927) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 13:11:38 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:38 devstack sudo[73962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 13:11:38 devstack sudo[73962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:39 devstack sudo[73962]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:39 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:39 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:39 devstack sudo[73968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:11:39 devstack sudo[73968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:39 devstack sudo[73968]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:39 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:39 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:39 devstack sudo[73971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:11:39 devstack sudo[73971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:40 devstack sudo[73971]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:40 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.509s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:40 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:40 devstack sudo[73976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:11:40 devstack sudo[73976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:40 devstack cinder-volume[72819]: DEBUG dbcounter [-] [72819] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:11:40 devstack sudo[73976]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:40 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:40 devstack cinder-volume[72927]: DEBUG cinder.manager [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Notifying Schedulers of capabilities ... {{(pid=72927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:11:40 devstack cinder-volume[72927]: INFO cinder.volume.manager [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Driver initialization completed successfully. Apr 10 13:11:40 devstack cinder-volume[72927]: INFO cinder.manager [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Initiating service 2 cleanup Apr 10 13:11:40 devstack cinder-volume[72927]: INFO cinder.manager [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Service 2 cleanup completed. Apr 10 13:11:40 devstack cinder-volume[72927]: DEBUG cinder.service [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Creating RPC server for service cinder-volume {{(pid=72927) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 13:11:40 devstack cinder-volume[72927]: DEBUG cinder.service [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72927) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 13:11:40 devstack cinder-volume[72927]: INFO cinder.volume.manager [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 10 13:11:40 devstack cinder-volume[72927]: DEBUG cinder.volume.drivers.lvm [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Updating volume stats {{(pid=72927) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 13:11:40 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:40 devstack sudo[73983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 13:11:40 devstack sudo[73983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:41 devstack sudo[73983]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:41 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:41 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:41 devstack sudo[73989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:11:41 devstack sudo[73989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:41 devstack sudo[73989]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:41 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:41 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:41 devstack sudo[74046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:11:41 devstack sudo[74046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:42 devstack sudo[74046]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:42 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:42 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:11:42 devstack sudo[74049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:11:42 devstack sudo[74049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:11:42 devstack sudo[74049]: pam_unix(sudo:session): session closed for user root Apr 10 13:11:42 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:11:42 devstack cinder-volume[72927]: INFO cinder.volume.manager [None req-69f56cc7-5c53-46e8-8e40-84c21daeeb8f None None] Driver post RPC initialization completed successfully. Apr 10 13:11:50 devstack cinder-volume[72927]: DEBUG dbcounter [-] [72927] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:11:52 devstack cinder-volume[72927]: DEBUG dbcounter [-] [72927] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:13:07 devstack cinder-volume[72927]: DEBUG oslo_service.periodic_task [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:13:07 devstack cinder-volume[72927]: DEBUG cinder.volume.drivers.lvm [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Updating volume stats {{(pid=72927) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 13:13:07 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:13:07 devstack sudo[79026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 13:13:07 devstack sudo[79026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:13:08 devstack sudo[79026]: pam_unix(sudo:session): session closed for user root Apr 10 13:13:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:13:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:13:08 devstack sudo[79034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:13:08 devstack sudo[79034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:13:08 devstack sudo[79034]: pam_unix(sudo:session): session closed for user root Apr 10 13:13:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:13:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:13:08 devstack sudo[79039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:13:08 devstack sudo[79039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:13:08 devstack sudo[79039]: pam_unix(sudo:session): session closed for user root Apr 10 13:13:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:13:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:13:08 devstack sudo[79042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:13:08 devstack sudo[79042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:13:09 devstack sudo[79042]: pam_unix(sudo:session): session closed for user root Apr 10 13:13:09 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:13:09 devstack cinder-volume[72927]: DEBUG cinder.manager [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Notifying Schedulers of capabilities ... {{(pid=72927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:13:52 devstack cinder-volume[72927]: DEBUG dbcounter [-] [72927] Writing DB stats cinder:SELECT=1 {{(pid=72927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:13:52 devstack cinder-volume[72927]: DEBUG dbcounter [-] [72927] Writing DB stats cinder:UPDATE=1 {{(pid=72927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:14:07 devstack cinder-volume[72927]: DEBUG oslo_service.periodic_task [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:14:07 devstack cinder-volume[72927]: DEBUG cinder.volume.drivers.lvm [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Updating volume stats {{(pid=72927) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 13:14:07 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:14:07 devstack sudo[80882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 13:14:07 devstack sudo[80882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:14:08 devstack sudo[80882]: pam_unix(sudo:session): session closed for user root Apr 10 13:14:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:14:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:14:08 devstack sudo[80900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:14:08 devstack sudo[80900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:14:08 devstack sudo[80900]: pam_unix(sudo:session): session closed for user root Apr 10 13:14:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:14:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:14:08 devstack sudo[80915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 13:14:08 devstack sudo[80915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:14:08 devstack sudo[80915]: pam_unix(sudo:session): session closed for user root Apr 10 13:14:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.416s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:14:08 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:14:08 devstack sudo[80918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 13:14:08 devstack sudo[80918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:14:09 devstack sudo[80918]: pam_unix(sudo:session): session closed for user root Apr 10 13:14:09 devstack cinder-volume[72927]: DEBUG oslo_concurrency.processutils [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=72927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:14:09 devstack cinder-volume[72927]: DEBUG cinder.manager [None req-0e23764f-55a5-42e9-867d-6343ac288e1c None None] Notifying Schedulers of capabilities ... {{(pid=72927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:14:58 devstack cinder-volume[72819]: INFO oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Caught SIGTERM, stopping children Apr 10 13:14:58 devstack cinder-volume[72819]: DEBUG oslo_concurrency.lockutils [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Acquiring lock "singleton_lock" {{(pid=72819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 13:14:58 devstack cinder-volume[72819]: DEBUG oslo_concurrency.lockutils [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Acquired lock "singleton_lock" {{(pid=72819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 13:14:58 devstack cinder-volume[72819]: DEBUG oslo_concurrency.lockutils [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Releasing lock "singleton_lock" {{(pid=72819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 13:14:58 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Stop services. {{(pid=72819) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 13:14:58 devstack cinder-volume[72819]: DEBUG oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Killing children. {{(pid=72819) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 13:14:58 devstack cinder-volume[72819]: INFO oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Waiting on 1 children to exit Apr 10 13:15:00 devstack cinder-volume[72927]: DEBUG oslo_concurrency.lockutils [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Acquiring lock "singleton_lock" {{(pid=72927) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 13:15:00 devstack cinder-volume[72927]: DEBUG oslo_concurrency.lockutils [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Acquired lock "singleton_lock" {{(pid=72927) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 13:15:00 devstack cinder-volume[72927]: DEBUG oslo_concurrency.lockutils [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Releasing lock "singleton_lock" {{(pid=72927) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 13:15:00 devstack cinder-volume[72927]: WARNING amqp [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 13:15:00 devstack cinder-volume[72927]: WARNING amqp [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 13:15:00 devstack cinder-volume[72819]: INFO oslo_service.backend._eventlet.service [None req-dc89223c-a9bb-4990-9f45-6ed7a2cac15a None None] Child 72927 exited with status 0 Apr 10 13:15:01 devstack cinder-volume[82008]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 13:15:01 devstack cinder-volume[82008]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 13:15:01 devstack cinder-volume[82008]: we strongly recommend against using it for new projects. Apr 10 13:15:01 devstack cinder-volume[82008]: If you are already using Eventlet, we recommend migrating to a different Apr 10 13:15:01 devstack cinder-volume[82008]: framework. For more detail see Apr 10 13:15:01 devstack cinder-volume[82008]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 13:15:01 devstack cinder-volume[82008]: import eventlet # noqa Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 13:15:03 devstack cinder-volume[82008]: INFO dbcounter [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Registered counter for database cinder Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_db.sqlalchemy.engines [None req-823c812c-d796-47c0-821f-b23ace46891a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82008) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG dbcounter [-] [82008] Writer thread running {{(pid=82008) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 13:15:03 devstack cinder-volume[82008]: INFO cinder.rpc [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 13:15:03 devstack cinder-volume[82008]: INFO cinder.rpc [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_db.sqlalchemy.engines [None req-823c812c-d796-47c0-821f-b23ace46891a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82008) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:15:03 devstack cinder-volume[82008]: INFO cinder.volume.manager [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Determined volume DB was empty at startup. Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG cinder.volume.manager [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82008) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 13:15:03 devstack cinder-volume[82008]: INFO cinder.volume.manager [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 13:15:03 devstack cinder-volume[82008]: WARNING stevedore.named [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 13:15:03 devstack cinder-volume[82008]: WARNING castellan.key_manager [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 13:15:03 devstack cinder-volume[82008]: WARNING cinder.keymgr.conf_key_mgr [None req-823c812c-d796-47c0-821f-b23ace46891a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 13:15:03 devstack cinder-volume[82008]: INFO cinder.volume.manager [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_db.sqlalchemy.engines [None req-823c812c-d796-47c0-821f-b23ace46891a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82008) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:15:03 devstack cinder-volume[82008]: INFO oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Starting 1 workers Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Started child 82122 {{(pid=82008) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Full set of CONF: {{(pid=82008) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] ******************************************************************************** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Configuration options gathered from: {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] ================================================================================ {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] allow_availability_zone_fallback = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] allow_compression_on_image_upload = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] allowed_direct_url_schemes = [] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] api_rate_limit = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] auth_strategy = keystone {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_availability_zone = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_host = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_name = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_stats_polling_interval = 60 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backup_api_class = cinder.backup.api.API {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backup_name_template = backup-%s {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backup_use_same_host = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backup_use_temp_snapshot = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] chap_password = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] chap_username = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cinder_internal_tenant_project_id = b3caf7197e3944d88e5a1a80893bbdf9 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cinder_internal_tenant_user_id = 62a53aab17164da4a077965e24aae63e {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cluster = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] compression_format = gzip {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] compute_api_class = cinder.compute.nova.API {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] config_dir = [] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] config_source = [] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] control_exchange = openstack {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] debug = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] default_availability_zone = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] default_group_type = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] default_volume_type = QuobyteHD {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] disk_geometry = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] driver_client_cert = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] driver_client_cert_key = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] driver_data_namespace = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] driver_ssl_cert_path = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] driver_ssl_cert_verify = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] driver_use_ssl = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] enable_new_services = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] enable_unsupported_driver = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] enabled_backends = ['QuobyteHD'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] enforce_multipath_for_image_xfer = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] filter_function = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance_api_insecure = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance_api_servers = ['http://192.168.122.241/image'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82122]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance_api_ssl_compression = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance_ca_certificates_file = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance_catalog_info = image:glance:publicURL {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance_certfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance_keyfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance_num_retries = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance_request_timeout = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] goodness_function = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] graceful_shutdown_timeout = 5 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] group_api_class = cinder.group.api.API {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] host = devstack {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] image_compress_on_upload = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] image_conversion_address_space_limit = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] image_conversion_cpu_limit = 60 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] image_conversion_disable = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] image_upload_use_cinder_backend = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] image_upload_use_internal_tenant = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] image_volume_cache_enabled = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] image_volume_cache_max_count = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] image_volume_cache_max_size_gb = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] init_host_max_objects_retrieval = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] instance_format = [instance: %(uuid)s] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] iscsi_target_flags = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] iscsi_write_cache = on {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] iser_helper = tgtadm {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] iser_ip_address = 192.168.122.241 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] iser_port = 3260 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] log_color = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] log_config_append = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] log_dir = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] log_file = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] log_options = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] log_rotate_interval = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] log_rotate_interval_type = days {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] log_rotation_type = none {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] max_age = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] max_logfile_count = 30 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] max_logfile_size_mb = 200 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] max_over_subscription_ratio = 20.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] message_reap_interval = 86400 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] message_ttl = 2592000 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] migration_create_volume_timeout_secs = 300 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] monkey_patch = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] monkey_patch_modules = [] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] my_ip = 192.168.122.241 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] no_snapshot_gb_quota = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] num_iser_scan_tries = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] num_shell_tries = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] num_volume_device_scan_tries = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] nvmeof_conn_info_version = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] nvmet_ns_id = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] nvmet_port_id = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] osapi_max_limit = 1000 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] osapi_volume_ext_list = [] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] osapi_volume_listen = 0.0.0.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] osapi_volume_listen_port = 8776 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] osapi_volume_use_ssl = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] osapi_volume_workers = 2 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] per_volume_size_limit = -1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] periodic_fuzzy_delay = 60 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] periodic_interval = 60 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] project_id_regex = [0-9a-f\-]+ {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] public_endpoint = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] publish_errors = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] quota_backup_gigabytes = 1000 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] quota_backups = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82122]: INFO cinder.volume.manager [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 13:15:03 devstack cinder-volume[82122]: DEBUG cinder.volume.drivers.remotefs [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82122) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] quota_gigabytes = 1000 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] quota_groups = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] quota_snapshots = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] quota_volumes = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] rate_limit_burst = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] rate_limit_except_level = CRITICAL {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] rate_limit_interval = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] reinit_driver_count = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] replication_device = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] report_discard_supported = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] report_interval = 120 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] reservation_clean_interval = 86400 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] reservation_expire = 86400 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] reserved_image_namespaces = [] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] reserved_percentage = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] rpc_response_timeout = 120 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] run_external_periodic_tasks = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] scst_target_driver = iscsi {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] scst_target_iqn_name = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_down_time = 720 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] shell_completion = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] snapshot_name_template = snapshot-%s {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] split_loggers = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] state_path = /opt/stack/data/cinder {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] storage_availability_zone = nova {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] storage_protocol = iSCSI {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] syslog_log_facility = LOG_USER {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] target_helper = lioadm {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] target_ip_address = 192.168.122.241 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] target_port = 3260 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] target_protocol = iscsi {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] target_secondary_ip_addresses = [] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] trace_flags = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] transfer_api_class = cinder.transfer.api.API {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] transport_url = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] until_refresh = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] use_chap_auth = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] use_default_quota_class = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] use_journal = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] use_json = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] use_multipath_for_image_xfer = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] use_stderr = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] use_syslog = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] verify_glance_signatures = enabled {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_api_class = cinder.volume.api.API {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_backend_name = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_clear = zero {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_clear_ionice = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_clear_size = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_copy_bps_limit = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_dd_blocksize = 1M {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_name_template = volume-%s {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_service_inithost_offload = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volume_usage_audit_period = month {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] zoning_mode = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_concurrency.disable_process_locking = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.admin_password = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.admin_token = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.admin_user = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.auth_admin_prefix = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.auth_port = 35357 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.auth_protocol = https {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.auth_section = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.auth_type = password {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.auth_uri = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:03 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.auth_version = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.cache = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.certfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.delay_auth_decision = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.http_connect_timeout = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.identity_uri = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.include_service_catalog = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.insecure = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.interface = public {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.keyfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_password = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcache_username = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.region_name = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.service_token_roles_required = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.service_type = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.token_cache_time = 300 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.241/identity {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.backend = dogpile.cache.null {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.backend_argument = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.backend_expiration_time = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.config_prefix = cache.oslo {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.debug_cache_backend = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.enable_retry_client = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.enable_socket_keepalive = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.enabled = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.enforce_fips_mode = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.expiration_time = 600 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.hashclient_retry_attempts = 2 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.memcache_dead_retry = 300 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.memcache_pool_maxsize = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.memcache_sasl_enabled = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.password = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.proxies = [] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.redis_db = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.redis_sentinel_service_name = mymaster {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.redis_server = localhost:6379 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.retry_attempts = 2 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.retry_delay = 0.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.socket_keepalive_count = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.socket_keepalive_idle = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.socket_keepalive_interval = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.socket_timeout = 1.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.tls_allowed_ciphers = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.tls_cafile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.tls_certfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.tls_enabled = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.tls_keyfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cache.username = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] coordination.backend_url = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.asyncio_connection = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.asyncio_slave_connection = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.backend = sqlalchemy {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.connection = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.connection_debug = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.connection_parameters = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.connection_recycle_time = 3600 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.connection_trace = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.db_inc_retry_interval = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.db_max_retries = 20 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.db_max_retry_interval = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.db_retry_interval = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.max_overflow = 50 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.max_pool_size = 5 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.max_retries = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.mysql_wsrep_sync_wait = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.pool_timeout = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.retry_interval = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.slave_connection = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.sqlite_synchronous = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.synchronous_reader = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] database.use_db_reconnect = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.connection_string = messaging:// {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.enabled = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.es_doc_type = notification {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.es_scroll_size = 10000 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.es_scroll_time = 2m {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.filter_error_trace = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.hmac_keys = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.sentinel_service_name = mymaster {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.socket_timeout = 0.1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.trace_requests = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler.trace_sqlalchemy = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler_jaeger.process_tags = {} {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler_jaeger.service_name_prefix = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] profiler_otlp.service_name_prefix = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.enforce_new_defaults = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: WARNING oslo_config.cfg [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.enforce_scope = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.policy_default_rule = default {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.policy_file = policy.yaml {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_policy.remote_timeout = 60.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] privsep_osbrick.group = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] privsep_osbrick.helper_command = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] privsep_osbrick.user = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cinder_sys_admin.group = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cinder_sys_admin.helper_command = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] cinder_sys_admin.user = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_user.auth_section = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_user.auth_type = password {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82122) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 13:15:04 devstack cinder-volume[82122]: WARNING cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 13:15:04 devstack cinder-volume[82122]: WARNING cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG oslo_concurrency.processutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Running cmd (subprocess): mount.quobyte {{(pid=82122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_user.cafile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_user.certfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_user.collect_timing = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_user.insecure = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_user.keyfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_user.send_service_user_token = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_user.split_loggers = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] service_user.timeout = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance.auth_section = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance.auth_type = password {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance.certfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance.collect_timing = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance.insecure = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance.keyfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance.region_name = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance.split_loggers = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] glance.timeout = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.backend_availability_zone = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.chap_password = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.chap_username = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.disk_geometry = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.driver_client_cert = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.driver_client_cert_key = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.driver_data_namespace = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.driver_use_ssl = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.enable_unsupported_driver = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.extra_capabilities = {} {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.filter_function = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.goodness_function = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.iscsi_target_flags = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.iscsi_write_cache = on {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.iser_helper = tgtadm {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.iser_ip_address = 192.168.122.241 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.iser_port = 3260 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nas_host = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nas_login = admin {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nas_mount_options = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nas_password = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nas_private_key = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nas_share_path = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nas_ssh_port = 22 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.num_shell_tries = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.nvmet_port_id = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.quobyte_client_cfg = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.quobyte_volume_url = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.replication_device = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.report_discard_supported = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.reserved_percentage = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.scst_target_driver = iscsi {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.scst_target_iqn_name = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.storage_protocol = iSCSI {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.target_helper = tgtadm {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.target_ip_address = 192.168.122.241 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.target_port = 3260 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.target_protocol = iscsi {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.trace_flags = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.unique_fqdn_network = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.use_chap_auth = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.volume_backend_name = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.volume_clear = zero {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.volume_clear_ionice = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.volume_clear_size = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_reports.file_event_handler = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_reports.log_dir = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.backend_availability_zone = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.backend_host = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.chap_password = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.chap_username = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.chiscsi_conf = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.disk_geometry = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.driver_client_cert = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.driver_client_cert_key = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.driver_data_namespace = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.driver_use_ssl = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.extra_capabilities = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.filter_function = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.goodness_function = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.iscsi_target_flags = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.iscsi_write_cache = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.iser_helper = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.iser_ip_address = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.iser_port = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.iser_target_prefix = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nas_host = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nas_login = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nas_mount_options = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nas_password = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nas_private_key = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nas_share_path = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nas_ssh_port = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.num_shell_tries = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nvmet_ns_id = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.nvmet_port_id = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.replication_device = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.report_discard_supported = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.reserved_percentage = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.scst_target_driver = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.storage_protocol = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.target_helper = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.target_ip_address = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.target_port = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.target_prefix = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.target_protocol = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.trace_flags = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.unique_fqdn_network = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.use_chap_auth = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.volume_clear = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.volume_clear_ionice = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.volume_clear_size = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] QuobyteHD.volumes_dir = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.ssl = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.ssl_version = {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_notifications.driver = [] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_notifications.retry = -1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] oslo_messaging_notifications.transport_url = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] key_manager.fixed_key = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.barbican_api_version = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.barbican_endpoint = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.barbican_endpoint_type = public {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.barbican_region_name = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.cafile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.certfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.collect_timing = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.insecure = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.keyfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.number_of_retries = 60 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.retry_delay = 1 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.send_service_user_token = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.split_loggers = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.timeout = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.verify_ssl = True {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican.verify_ssl_path = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican_service_user.auth_section = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican_service_user.auth_type = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican_service_user.cafile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican_service_user.certfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican_service_user.collect_timing = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican_service_user.insecure = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican_service_user.keyfile = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican_service_user.split_loggers = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] barbican_service_user.timeout = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.approle_role_id = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.approle_secret_id = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.kv_mountpoint = secret {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.kv_path = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.kv_version = 2 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.namespace = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.root_token_id = **** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.ssl_ca_crt_file = None {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.timeout = 60.0 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.use_ssl = False {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:04 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] ******************************************************************************** {{(pid=82008) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 13:15:04 devstack quobyte-client[82126]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 13:15:04 devstack quobyte-client[82126]: Invalid parameters found, error: missing mount point. Apr 10 13:15:04 devstack quobyte-client[82126]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 13:15:04 devstack quobyte-client[82126]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG oslo_concurrency.processutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] CMD "mount.quobyte" returned: 1 in 0.098s {{(pid=82122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:15:04 devstack cinder-volume[82122]: INFO cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 ... Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG oslo_concurrency.processutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c -c /etc/quobyte/client-cinder.cfg {{(pid=82122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:15:04 devstack sudo[82127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c -c /etc/quobyte/client-cinder.cfg Apr 10 13:15:04 devstack sudo[82127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:15:04 devstack sudo[82127]: pam_unix(sudo:session): session closed for user root Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG oslo_concurrency.processutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.476s {{(pid=82122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:15:04 devstack cinder-volume[82122]: INFO cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 succeeded Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.482s {{(pid=82122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:15:04 devstack cinder-volume[82122]: DEBUG oslo_concurrency.processutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:15:04 devstack sudo[82196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:15:04 devstack sudo[82196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:15:05 devstack sudo[82196]: pam_unix(sudo:session): session closed for user root Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_concurrency.processutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.377s {{(pid=82122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:15:05 devstack cinder-volume[82122]: INFO cinder.volume.driver [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Driver hasn't implemented _init_vendor_properties() Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG cinder.volume.driver [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6976852416992, 'free_capacity_gb': 1775.6976852416992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82122) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_db.sqlalchemy.engines [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG dbcounter [-] [82122] Writer thread running {{(pid=82122) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG cinder.db.sqlalchemy.api [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Building query based on filter {{(pid=82122) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG cinder.image.image_utils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82122) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 13:15:05 devstack cinder-volume[82122]: INFO cinder.keymgr.migration [None req-89fa3b6d-5bb4-4e7d-b437-681afdfbf722 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_concurrency.processutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:15:05 devstack sudo[82199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:15:05 devstack sudo[82199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:15:05 devstack sudo[82199]: pam_unix(sudo:session): session closed for user root Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_concurrency.processutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.376s {{(pid=82122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG cinder.manager [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Notifying Schedulers of capabilities ... {{(pid=82122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:15:05 devstack cinder-volume[82122]: INFO cinder.volume.manager [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Driver initialization completed successfully. Apr 10 13:15:05 devstack cinder-volume[82122]: INFO cinder.manager [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Initiating service 3 cleanup Apr 10 13:15:05 devstack cinder-volume[82122]: INFO cinder.manager [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Service 3 cleanup completed. Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG cinder.service [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Creating RPC server for service cinder-volume {{(pid=82122) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG cinder.service [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82122) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 13:15:05 devstack cinder-volume[82122]: INFO cinder.volume.manager [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG cinder.volume.drivers.quobyte [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:15:05 devstack cinder-volume[82122]: DEBUG oslo_concurrency.processutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:15:05 devstack sudo[82203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:15:05 devstack sudo[82203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:15:06 devstack sudo[82203]: pam_unix(sudo:session): session closed for user root Apr 10 13:15:06 devstack cinder-volume[82122]: DEBUG oslo_concurrency.processutils [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.479s {{(pid=82122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:15:06 devstack cinder-volume[82122]: INFO cinder.volume.manager [None req-d82136e1-164e-4b2d-bcad-6132b3901ddd None None] Driver post RPC initialization completed successfully. Apr 10 13:15:07 devstack cinder-volume[82008]: INFO oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Caught SIGTERM, stopping children Apr 10 13:15:07 devstack cinder-volume[82008]: DEBUG oslo_concurrency.lockutils [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Acquiring lock "singleton_lock" {{(pid=82008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 13:15:07 devstack cinder-volume[82008]: DEBUG oslo_concurrency.lockutils [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Acquired lock "singleton_lock" {{(pid=82008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 13:15:07 devstack cinder-volume[82008]: DEBUG oslo_concurrency.lockutils [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Releasing lock "singleton_lock" {{(pid=82008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 13:15:07 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Stop services. {{(pid=82008) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 13:15:07 devstack cinder-volume[82008]: DEBUG oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Killing children. {{(pid=82008) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 13:15:07 devstack cinder-volume[82008]: INFO oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Waiting on 1 children to exit Apr 10 13:15:09 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Acquiring lock "singleton_lock" {{(pid=82122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 13:15:09 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Acquired lock "singleton_lock" {{(pid=82122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 13:15:09 devstack cinder-volume[82122]: DEBUG oslo_concurrency.lockutils [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Releasing lock "singleton_lock" {{(pid=82122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 13:15:09 devstack cinder-volume[82122]: WARNING amqp [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 13:15:09 devstack cinder-volume[82122]: WARNING amqp [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 13:15:09 devstack cinder-volume[82008]: INFO oslo_service.backend._eventlet.service [None req-823c812c-d796-47c0-821f-b23ace46891a None None] Child 82122 exited with status 0 Apr 10 13:15:10 devstack cinder-volume[82346]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 13:15:10 devstack cinder-volume[82346]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 13:15:10 devstack cinder-volume[82346]: we strongly recommend against using it for new projects. Apr 10 13:15:10 devstack cinder-volume[82346]: If you are already using Eventlet, we recommend migrating to a different Apr 10 13:15:10 devstack cinder-volume[82346]: framework. For more detail see Apr 10 13:15:10 devstack cinder-volume[82346]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 13:15:10 devstack cinder-volume[82346]: import eventlet # noqa Apr 10 13:15:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 13:15:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 13:15:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82346) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 13:15:12 devstack cinder-volume[82346]: INFO dbcounter [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Registered counter for database cinder Apr 10 13:15:12 devstack cinder-volume[82346]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82346) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:15:12 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writer thread running {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 13:15:12 devstack cinder-volume[82346]: INFO cinder.rpc [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 13:15:12 devstack cinder-volume[82346]: INFO cinder.rpc [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 13:15:12 devstack cinder-volume[82346]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82346) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:15:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Determined volume DB was empty at startup. Apr 10 13:15:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82346) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 13:15:12 devstack cinder-volume[82346]: WARNING stevedore.named [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 13:15:12 devstack cinder-volume[82346]: WARNING castellan.key_manager [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 13:15:12 devstack cinder-volume[82346]: WARNING cinder.keymgr.conf_key_mgr [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 13:15:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 13:15:12 devstack cinder-volume[82346]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82346) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:15:12 devstack cinder-volume[82346]: INFO oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Starting 1 workers Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Started child 82554 {{(pid=82346) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Full set of CONF: {{(pid=82346) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] ******************************************************************************** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Configuration options gathered from: {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] ================================================================================ {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 13:15:13 devstack cinder-volume[82554]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] allow_availability_zone_fallback = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] allow_compression_on_image_upload = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] allowed_direct_url_schemes = [] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] api_rate_limit = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] auth_strategy = keystone {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_availability_zone = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_host = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_name = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_stats_polling_interval = 60 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backup_api_class = cinder.backup.api.API {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backup_name_template = backup-%s {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backup_use_same_host = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backup_use_temp_snapshot = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] chap_password = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] chap_username = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cinder_internal_tenant_project_id = b3caf7197e3944d88e5a1a80893bbdf9 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cinder_internal_tenant_user_id = 62a53aab17164da4a077965e24aae63e {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cluster = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] compression_format = gzip {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] compute_api_class = cinder.compute.nova.API {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] config_dir = [] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] config_source = [] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] control_exchange = openstack {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] debug = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] default_availability_zone = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] default_group_type = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] default_volume_type = QuobyteHD {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] disk_geometry = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] driver_client_cert = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] driver_client_cert_key = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] driver_data_namespace = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] driver_ssl_cert_path = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] driver_ssl_cert_verify = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] driver_use_ssl = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] enable_new_services = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] enable_unsupported_driver = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] enabled_backends = ['QuobyteHD'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] enforce_multipath_for_image_xfer = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] filter_function = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance_api_insecure = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance_api_servers = ['http://192.168.122.241/image'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance_api_ssl_compression = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance_ca_certificates_file = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance_catalog_info = image:glance:publicURL {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance_certfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance_keyfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance_num_retries = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance_request_timeout = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] goodness_function = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] graceful_shutdown_timeout = 5 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] group_api_class = cinder.group.api.API {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] host = devstack {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] image_compress_on_upload = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] image_conversion_address_space_limit = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] image_conversion_cpu_limit = 60 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] image_conversion_disable = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] image_upload_use_cinder_backend = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] image_upload_use_internal_tenant = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] image_volume_cache_enabled = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] image_volume_cache_max_count = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] image_volume_cache_max_size_gb = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] init_host_max_objects_retrieval = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] instance_format = [instance: %(uuid)s] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] iscsi_target_flags = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] iscsi_write_cache = on {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] iser_helper = tgtadm {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] iser_ip_address = 192.168.122.241 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] iser_port = 3260 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] log_color = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] log_config_append = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] log_dir = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] log_file = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] log_options = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] log_rotate_interval = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] log_rotate_interval_type = days {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] log_rotation_type = none {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] max_age = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] max_logfile_count = 30 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] max_logfile_size_mb = 200 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] max_over_subscription_ratio = 20.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] message_reap_interval = 86400 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] message_ttl = 2592000 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] migration_create_volume_timeout_secs = 300 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82554) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] monkey_patch = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] monkey_patch_modules = [] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] my_ip = 192.168.122.241 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] no_snapshot_gb_quota = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] num_iser_scan_tries = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] num_shell_tries = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] num_volume_device_scan_tries = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] nvmeof_conn_info_version = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] nvmet_ns_id = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] nvmet_port_id = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] osapi_max_limit = 1000 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] osapi_volume_ext_list = [] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] osapi_volume_listen_port = 8776 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] osapi_volume_use_ssl = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] osapi_volume_workers = 2 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] per_volume_size_limit = -1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] periodic_fuzzy_delay = 60 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] periodic_interval = 60 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] public_endpoint = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] publish_errors = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] quota_backup_gigabytes = 1000 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] quota_backups = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] quota_gigabytes = 1000 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] quota_groups = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] quota_snapshots = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] quota_volumes = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] rate_limit_burst = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] rate_limit_except_level = CRITICAL {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] rate_limit_interval = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] reinit_driver_count = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] replication_device = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] report_discard_supported = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] report_interval = 120 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] reservation_clean_interval = 86400 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] reservation_expire = 86400 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] reserved_image_namespaces = [] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] reserved_percentage = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] rpc_response_timeout = 120 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] run_external_periodic_tasks = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] scst_target_driver = iscsi {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] scst_target_iqn_name = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_down_time = 720 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] shell_completion = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] snapshot_name_template = snapshot-%s {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] split_loggers = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] state_path = /opt/stack/data/cinder {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] storage_availability_zone = nova {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] storage_protocol = iSCSI {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] syslog_log_facility = LOG_USER {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] target_helper = lioadm {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] target_ip_address = 192.168.122.241 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] target_port = 3260 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] target_protocol = iscsi {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] target_secondary_ip_addresses = [] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] trace_flags = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] transport_url = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] until_refresh = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] use_chap_auth = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] use_default_quota_class = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] use_journal = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] use_json = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] use_multipath_for_image_xfer = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] use_stderr = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] use_syslog = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] verify_glance_signatures = enabled {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_api_class = cinder.volume.api.API {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_backend_name = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_clear = zero {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_clear_ionice = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_clear_size = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_copy_bps_limit = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_dd_blocksize = 1M {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_name_template = volume-%s {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_service_inithost_offload = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volume_usage_audit_period = month {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] zoning_mode = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_concurrency.disable_process_locking = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.admin_password = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.admin_token = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.admin_user = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.auth_port = 35357 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.auth_protocol = https {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.auth_section = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.auth_type = password {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.auth_uri = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.auth_version = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.cache = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.certfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.identity_uri = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.include_service_catalog = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.insecure = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.interface = public {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.keyfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_password = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82554) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 13:15:13 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.quobyte [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 13:15:13 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.quobyte [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcache_username = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Running cmd (subprocess): mount.quobyte {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.region_name = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.service_type = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.241/identity {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.backend = dogpile.cache.null {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.backend_argument = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.backend_expiration_time = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.config_prefix = cache.oslo {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.debug_cache_backend = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.enable_retry_client = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.enable_socket_keepalive = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.enabled = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.enforce_fips_mode = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.expiration_time = 600 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.hashclient_retry_attempts = 2 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.memcache_dead_retry = 300 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.memcache_pool_maxsize = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.memcache_sasl_enabled = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.password = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.proxies = [] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.redis_db = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.redis_server = localhost:6379 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.retry_attempts = 2 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.retry_delay = 0.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.socket_keepalive_count = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.socket_keepalive_idle = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.socket_keepalive_interval = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.socket_timeout = 1.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.tls_allowed_ciphers = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.tls_cafile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.tls_certfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.tls_enabled = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.tls_keyfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cache.username = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] coordination.backend_url = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.asyncio_connection = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.asyncio_slave_connection = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.backend = sqlalchemy {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.connection = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.connection_debug = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.connection_parameters = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.connection_recycle_time = 3600 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.connection_trace = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.db_inc_retry_interval = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.db_max_retries = 20 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.db_max_retry_interval = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.db_retry_interval = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.max_overflow = 50 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.max_pool_size = 5 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.max_retries = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.mysql_wsrep_sync_wait = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.pool_timeout = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.retry_interval = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.slave_connection = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.sqlite_synchronous = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.synchronous_reader = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] database.use_db_reconnect = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.connection_string = messaging:// {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.enabled = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.es_doc_type = notification {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.es_scroll_size = 10000 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.es_scroll_time = 2m {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.filter_error_trace = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.hmac_keys = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.sentinel_service_name = mymaster {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.socket_timeout = 0.1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.trace_requests = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler.trace_sqlalchemy = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler_jaeger.process_tags = {} {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler_jaeger.service_name_prefix = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] profiler_otlp.service_name_prefix = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.enforce_new_defaults = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: WARNING oslo_config.cfg [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.enforce_scope = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.policy_default_rule = default {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.policy_file = policy.yaml {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] privsep_osbrick.group = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] privsep_osbrick.helper_command = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] privsep_osbrick.user = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cinder_sys_admin.group = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cinder_sys_admin.helper_command = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] cinder_sys_admin.user = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_user.auth_section = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_user.auth_type = password {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_user.cafile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_user.certfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_user.collect_timing = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_user.insecure = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_user.keyfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_user.send_service_user_token = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_user.split_loggers = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] service_user.timeout = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance.auth_section = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance.auth_type = password {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance.certfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance.collect_timing = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance.insecure = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance.keyfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance.region_name = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance.split_loggers = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] glance.timeout = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.backend_availability_zone = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.chap_password = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.chap_username = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.disk_geometry = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.driver_client_cert = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.driver_client_cert_key = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.driver_data_namespace = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.driver_use_ssl = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.extra_capabilities = {} {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.filter_function = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.goodness_function = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack quobyte-client[82561]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 13:15:13 devstack quobyte-client[82561]: Invalid parameters found, error: missing mount point. Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.iscsi_target_flags = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack quobyte-client[82561]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 13:15:13 devstack quobyte-client[82561]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.iscsi_write_cache = on {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.iser_helper = tgtadm {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.iser_ip_address = 192.168.122.241 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.iser_port = 3260 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nas_host = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nas_login = admin {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nas_mount_options = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nas_password = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nas_private_key = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nas_share_path = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.num_shell_tries = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.quobyte_volume_url = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.replication_device = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.report_discard_supported = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.reserved_percentage = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.target_helper = tgtadm {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.target_ip_address = 192.168.122.241 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.target_port = 3260 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.target_protocol = iscsi {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.trace_flags = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.unique_fqdn_network = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.use_chap_auth = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.volume_backend_name = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.volume_clear = zero {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.volume_clear_ionice = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.volume_clear_size = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_reports.file_event_handler = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_reports.log_dir = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.backend_availability_zone = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.backend_host = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.chap_password = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.chap_username = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.chiscsi_conf = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.disk_geometry = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.driver_client_cert = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.driver_data_namespace = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.driver_use_ssl = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.extra_capabilities = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.filter_function = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.goodness_function = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.iser_helper = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.iser_ip_address = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.iser_port = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.iser_target_prefix = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nas_host = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nas_login = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nas_mount_options = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nas_password = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nas_private_key = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nas_share_path = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nas_ssh_port = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.num_shell_tries = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.nvmet_port_id = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack sudo[82570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.replication_device = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.report_discard_supported = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.reserved_percentage = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.scst_target_driver = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.storage_protocol = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.target_helper = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack sudo[82570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.target_ip_address = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.target_port = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.target_prefix = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.target_protocol = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.trace_flags = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.use_chap_auth = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.volume_clear = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.volume_clear_size = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] QuobyteHD.volumes_dir = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.ssl = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_notifications.driver = [] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_notifications.retry = -1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] key_manager.fixed_key = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.barbican_api_version = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.barbican_endpoint = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.barbican_endpoint_type = public {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.barbican_region_name = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.cafile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.certfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.collect_timing = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.insecure = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.keyfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.number_of_retries = 60 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.retry_delay = 1 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.send_service_user_token = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.split_loggers = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.timeout = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.verify_ssl = True {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican.verify_ssl_path = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican_service_user.auth_section = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican_service_user.auth_type = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican_service_user.cafile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican_service_user.certfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican_service_user.collect_timing = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican_service_user.insecure = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican_service_user.keyfile = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican_service_user.split_loggers = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] barbican_service_user.timeout = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.approle_role_id = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.approle_secret_id = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.kv_mountpoint = secret {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.kv_path = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.kv_version = 2 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.namespace = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.root_token_id = **** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.ssl_ca_crt_file = None {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.timeout = 60.0 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.use_ssl = False {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 13:15:13 devstack cinder-volume[82346]: DEBUG oslo_service.backend._eventlet.service [None req-8ecd3b26-dc53-44f2-89cf-ae6f189315b3 None None] ******************************************************************************** {{(pid=82346) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 13:15:13 devstack sudo[82570]: pam_unix(sudo:session): session closed for user root Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.433s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:15:13 devstack cinder-volume[82554]: INFO cinder.volume.driver [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG cinder.volume.driver [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953620910645, 'free_capacity_gb': 1775.6953620910645, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82554) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_db.sqlalchemy.engines [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82554) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writer thread running {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG cinder.db.sqlalchemy.api [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Building query based on filter {{(pid=82554) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82554) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:15:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:15:13 devstack cinder-volume[82554]: INFO cinder.keymgr.migration [None req-81ca279c-4e3e-4ee9-9838-c17bca9a7598 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 13:15:13 devstack sudo[82587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:15:13 devstack sudo[82587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:15:14 devstack sudo[82587]: pam_unix(sudo:session): session closed for user root Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.438s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:15:14 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Driver initialization completed successfully. Apr 10 13:15:14 devstack cinder-volume[82554]: INFO cinder.manager [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Initiating service 3 cleanup Apr 10 13:15:14 devstack cinder-volume[82554]: INFO cinder.manager [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Service 3 cleanup completed. Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG cinder.service [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Creating RPC server for service cinder-volume {{(pid=82554) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG cinder.service [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82554) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 13:15:14 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:15:14 devstack sudo[82591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:15:14 devstack sudo[82591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:15:14 devstack sudo[82591]: pam_unix(sudo:session): session closed for user root Apr 10 13:15:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.401s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:15:14 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a4710b23-194d-45df-9db5-f18831683a78 None None] Driver post RPC initialization completed successfully. Apr 10 13:15:22 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:15:24 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=1 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:15:24 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Flow 'volume_create_manager' (1bbf7c51-3cd8-4641-a23d-e0cc7f98429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9841a500-1cff-48f2-ad72-d0ad812cf2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9841a500-1cff-48f2-ad72-d0ad812cf2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-51217935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6d7d3e-555e-4166-9d6a-83d56d910e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2d58d112dc449a86414934c728f6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:12Z,use_quota=True,user_id='3ce4f4bc2e934100b92aca6b432eb410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ea6df9-a5c2-4ac7-b05c-2e1eabfa7577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ea6df9-a5c2-4ac7-b05c-2e1eabfa7577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875a0f2b-0d1a-4515-89ea-e323179c8a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875a0f2b-0d1a-4515-89ea-e323179c8a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6d7d3e-555e-4166-9d6a-83d56d910e36', 'volume_name': 'volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b91f345-aefe-4f65-a5ea-c02df91bf5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b91f345-aefe-4f65-a5ea-c02df91bf5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b593c92f-494c-4b9e-a2d9-85948e10b775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:11 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Volume 0e6d7d3e-555e-4166-9d6a-83d56d910e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36', 'volume_size': 1} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-51217935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6d7d3e-555e-4166-9d6a-83d56d910e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2d58d112dc449a86414934c728f6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:12Z,use_quota=True,user_id='3ce4f4bc2e934100b92aca6b432eb410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Creating volume 0e6d7d3e-555e-4166-9d6a-83d56d910e36 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:16:11 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:16:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:11 devstack sudo[82967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 1073741824 Apr 10 13:16:11 devstack sudo[82967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:12 devstack sudo[82967]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 1073741824" returned: 0 in 0.787s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:12 devstack sudo[83300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 Apr 10 13:16:12 devstack sudo[83300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:13 devstack sudo[83300]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36" returned: 0 in 0.529s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:16:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b593c92f-494c-4b9e-a2d9-85948e10b775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4786409-f9e6-48a2-9fa7-2eea0cb4d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:13 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Volume volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 (0e6d7d3e-555e-4166-9d6a-83d56d910e36): created successfully Apr 10 13:16:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4786409-f9e6-48a2-9fa7-2eea0cb4d352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Flow 'volume_create_manager' (1bbf7c51-3cd8-4641-a23d-e0cc7f98429e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:16:13 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-5fa0a8c9-5e6b-47fc-8088-de4eb99169c7 req-3d8fafaa-d58a-4d54-925a-b19995258789 tempest-VolumesSnapshotsTestJSON-1553963877 None] Created volume successfully. Apr 10 13:16:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Creating offline snapshot 9c44933a-795d-4b0c-87be-4921b2ddac8b of volume 0e6d7d3e-555e-4166-9d6a-83d56d910e36 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:16:14 devstack cinder-volume[82554]: INFO oslo.privsep.daemon [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplbl9f042/privsep.sock'] Apr 10 13:16:14 devstack sudo[83326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplbl9f042/privsep.sock Apr 10 13:16:14 devstack sudo[83326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 13:16:15 devstack cinder-volume[82554]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Flow 'volume_create_manager' (089b10e4-14c3-4ce4-8394-59032a855e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0842f0-bc73-4b95-8a06-061f472d7de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0842f0-bc73-4b95-8a06-061f472d7de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1897044424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba1100cc2614ba4a9b91fa458f52e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:16Z,use_quota=True,user_id='dbed043a116f487fb5fd9b6712cbc307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7726d2fb-cb33-4b37-9da8-402f516cd7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7726d2fb-cb33-4b37-9da8-402f516cd7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c009891-1f0a-4a43-8052-b1e64b4115cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c009891-1f0a-4a43-8052-b1e64b4115cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb', 'volume_name': 'volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9efc26-380c-4c2a-b743-a72751942721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9efc26-380c-4c2a-b743-a72751942721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1787ae9-bab5-4b7d-9461-600748d3d6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:15 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Volume 4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb', 'volume_size': 1} Apr 10 13:16:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:16 devstack sudo[83326]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:16 devstack cinder-volume[82554]: INFO oslo.privsep.daemon [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Spawned new privsep daemon via rootwrap Apr 10 13:16:16 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Accepted privsep connection to /tmp/tmplbl9f042/privsep.sock {{(pid=82554) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 10 13:16:16 devstack cinder-volume[82554]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 10 13:16:16 devstack cinder-volume[82554]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 10 13:16:16 devstack cinder-volume[82554]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 10 13:16:16 devstack cinder-volume[82554]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83337 Apr 10 13:16:16 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bb4230-5e53-4ce9-93a3-c4feeb23bc78]: (2,) {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:16 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c3a7f9-4f29-4522-972e-fd06ff5c4aff]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:16 devstack sudo[83340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 Apr 10 13:16:16 devstack sudo[83340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:16 devstack sudo[83340]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36" returned: 0 in 0.553s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:16 devstack sudo[83349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b 1G Apr 10 13:16:16 devstack sudo[83349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:17 devstack sudo[83349]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b 1G" returned: 0 in 0.539s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:17 devstack sudo[83356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b Apr 10 13:16:17 devstack sudo[83356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:17 devstack sudo[83356]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b" returned: 0 in 0.566s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:17 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b is being set with open permissions: ugo+rw Apr 10 13:16:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:17 devstack sudo[83363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b Apr 10 13:16:17 devstack sudo[83363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:18 devstack sudo[83363]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b" returned: 0 in 0.523s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:18 devstack sudo[83366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.info Apr 10 13:16:18 devstack sudo[83366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:18 devstack sudo[83366]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.info" returned: 0 in 0.420s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:18 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.info is being set with open permissions: ugo+rw Apr 10 13:16:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:18 devstack sudo[83369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.info Apr 10 13:16:18 devstack sudo[83369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:19 devstack sudo[83369]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.info" returned: 0 in 0.423s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.885s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.589s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1897044424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba1100cc2614ba4a9b91fa458f52e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:16Z,use_quota=True,user_id='dbed043a116f487fb5fd9b6712cbc307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Creating volume 4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:16:19 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:16:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:19 devstack sudo[83372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb 1073741824 Apr 10 13:16:19 devstack sudo[83372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:19 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-0be75915-f613-49c4-b833-7885aa4646e4 req-f539cfe4-3a51-429a-b14c-1de9681c486a tempest-VolumesSnapshotsTestJSON-1553963877 None] Create snapshot completed successfully Apr 10 13:16:20 devstack sudo[83372]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb 1073741824" returned: 0 in 0.681s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:20 devstack sudo[83386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb Apr 10 13:16:20 devstack sudo[83386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Acquiring lock "cinder-9c44933a-795d-4b0c-87be-4921b2ddac8b-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "cinder-9c44933a-795d-4b0c-87be-4921b2ddac8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Acquiring lock "cinder-quobyte-0e6d7d3e-555e-4166-9d6a-83d56d910e36" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "cinder-quobyte-0e6d7d3e-555e-4166-9d6a-83d56d910e36" acquired by "delete_snapshot" :: waited 0.055s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Acquiring lock "cinder-quobyte-9c44933a-795d-4b0c-87be-4921b2ddac8b" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "cinder-quobyte-9c44933a-795d-4b0c-87be-4921b2ddac8b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Deleting offline snapshot 9c44933a-795d-4b0c-87be-4921b2ddac8b of volume 0e6d7d3e-555e-4166-9d6a-83d56d910e36 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] snapshot_file for this snap is: volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[434c1f58-fdd3-42eb-a92d-7b42f5f8c29e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:20 devstack sudo[83404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b Apr 10 13:16:20 devstack sudo[83404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:21 devstack sudo[83386]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb" returned: 0 in 1.297s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1787ae9-bab5-4b7d-9461-600748d3d6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e387ebc9-7751-4043-9f51-b43df89b88ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:21 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Volume volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb (4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb): created successfully Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e387ebc9-7751-4043-9f51-b43df89b88ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:21 devstack sudo[83404]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Flow 'volume_create_manager' (089b10e4-14c3-4ce4-8394-59032a855e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b" returned: 0 in 0.778s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:16:21 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-042b8623-ead3-4d57-9a36-7bb6143d33cd tempest-VolumesAdminNegativeTest-590059666 None] Created volume successfully. Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9291163-c0b9-4d89-ac5f-dd93403c780c]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:21 devstack sudo[83413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 Apr 10 13:16:21 devstack sudo[83413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG oslo_service.periodic_task [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82554) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:22 devstack sudo[83435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:16:22 devstack sudo[83435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Acquiring lock "cinder-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Lock "cinder-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Acquiring lock "cinder-quobyte-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Lock "cinder-quobyte-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb" acquired by "delete_volume" :: waited 0.023s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:22 devstack sudo[83413]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36" returned: 0 in 1.366s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a4499-b019-4a01-a368-8d0495e4869a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:23 devstack sudo[83438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b Apr 10 13:16:23 devstack sudo[83438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:23 devstack sudo[83439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb Apr 10 13:16:23 devstack sudo[83439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:23 devstack sudo[83435]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 1.015s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:23 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:16:23 devstack sudo[83439]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb" returned: 0 in 1.006s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:24 devstack sudo[83450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb Apr 10 13:16:24 devstack sudo[83450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:24 devstack sudo[83438]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b" returned: 0 in 1.243s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:24 devstack sudo[83452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b Apr 10 13:16:24 devstack sudo[83452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:24 devstack sudo[83450]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb" returned: 0 in 0.840s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Lock "cinder-quobyte-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb" released by "delete_volume" :: held 1.933s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:24 devstack cinder-volume[82554]: WARNING cinder.quota [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:16:24 devstack cinder-volume[82554]: WARNING cinder.quota [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:16:24 devstack sudo[83452]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:24 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Created reservations ['cc055d81-a980-4255-9373-97b18583de31', 'fa75ffae-e027-4048-a42c-a7e5953bdedc', '793437ab-ef04-4aac-9de8-26ca01eaec0a', '8d1a151a-b7e9-4371-87cd-37a9eda521e5'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:16:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36.9c44933a-795d-4b0c-87be-4921b2ddac8b" returned: 0 in 0.793s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "cinder-quobyte-9c44933a-795d-4b0c-87be-4921b2ddac8b" released by "_delete_snapshot" :: held 4.420s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "cinder-quobyte-0e6d7d3e-555e-4166-9d6a-83d56d910e36" released by "delete_snapshot" :: held 4.467s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:25 devstack cinder-volume[82554]: WARNING cinder.quota [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:16:25 devstack sudo[83457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:16:25 devstack sudo[83457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG cinder.quota [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Created reservations ['36492cf3-4d3d-4a2e-80b5-ad7d41bdb04f', 'a574d7b4-5a01-4a0e-b49b-1af8ffe48e02', '8644efa6-7e3e-455e-9f6e-de9c6027da4e', '437a83c0-619e-4832-bf00-09e18252e291'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:16:25 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Delete snapshot completed successfully. Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-8ec6b7bb-d846-4c6c-8088-04e9d7d458d7 req-fe95d8dc-ca35-4231-8da7-65820f75a464 tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "cinder-9c44933a-795d-4b0c-87be-4921b2ddac8b-delete_snapshot" released by "delete_snapshot" :: held 4.722s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:25 devstack sudo[83457]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.545s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:16:25 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Deleted volume successfully. Apr 10 13:16:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-74df40f1-4ba1-4ab3-a3dd-f52397f6fb7e tempest-VolumesAdminNegativeTest-590059666 None] Lock "cinder-4d35cd92-ead5-4ce5-a7dc-7992fbc41cbb-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Acquiring lock "cinder-0e6d7d3e-555e-4166-9d6a-83d56d910e36-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "cinder-0e6d7d3e-555e-4166-9d6a-83d56d910e36-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Acquiring lock "cinder-quobyte-0e6d7d3e-555e-4166-9d6a-83d56d910e36" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "cinder-quobyte-0e6d7d3e-555e-4166-9d6a-83d56d910e36" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:26 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4d48d6-9dba-4de7-90aa-eaa3bb01d311]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:26 devstack sudo[83464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 Apr 10 13:16:26 devstack sudo[83464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:27 devstack sudo[83464]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36" returned: 0 in 0.799s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:27 devstack sudo[83477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36 Apr 10 13:16:27 devstack sudo[83477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:27 devstack sudo[83477]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e6d7d3e-555e-4166-9d6a-83d56d910e36" returned: 0 in 0.689s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "cinder-quobyte-0e6d7d3e-555e-4166-9d6a-83d56d910e36" released by "delete_volume" :: held 1.611s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG cinder.quota [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Created reservations ['53e284b6-3bd2-4c99-a9e4-6385c594f6b9', '214de120-7268-463e-a9be-6fb879a71184', 'd2bf6d53-84a8-4d9b-b52c-683aaa26239f', 'a3694cea-a631-415c-b079-8cc144d7c445'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:27 devstack sudo[83541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:16:27 devstack sudo[83541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:28 devstack sudo[83541]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.646s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:28 devstack cinder-volume[82554]: DEBUG cinder.manager [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:16:28 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Deleted volume successfully. Apr 10 13:16:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-1927e7c3-0702-438b-a897-1fa46226d755 req-fd266643-8ff3-4338-a9dd-1d5060a41eaa tempest-VolumesSnapshotsTestJSON-1553963877 None] Lock "cinder-0e6d7d3e-555e-4166-9d6a-83d56d910e36-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Flow 'volume_create_manager' (2957970a-1b0a-4527-8ed2-83593321ff16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0037b61-3b3b-4d0e-a8ed-4d2800c229c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0037b61-3b3b-4d0e-a8ed-4d2800c229c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-610651533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5561a8ec-5958-4896-b47c-3ac8b98676c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e962ef2d3fcc473c94634c477b322792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:30Z,use_quota=True,user_id='74bcc084d49c48908a6a8595ab19899d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61e0a3e-32db-4f53-be79-c603ebc4856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61e0a3e-32db-4f53-be79-c603ebc4856c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2231ed3a-cb63-467e-8296-7fadbbaafc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2231ed3a-cb63-467e-8296-7fadbbaafc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5561a8ec-5958-4896-b47c-3ac8b98676c7', 'volume_name': 'volume-5561a8ec-5958-4896-b47c-3ac8b98676c7', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58e1945-8c38-4a48-8e42-a49981678562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58e1945-8c38-4a48-8e42-a49981678562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc608d34-e645-41b6-9a65-b5a5de2f6ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:30 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Volume 5561a8ec-5958-4896-b47c-3ac8b98676c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5561a8ec-5958-4896-b47c-3ac8b98676c7', 'volume_size': 1} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-610651533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5561a8ec-5958-4896-b47c-3ac8b98676c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e962ef2d3fcc473c94634c477b322792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:30Z,use_quota=True,user_id='74bcc084d49c48908a6a8595ab19899d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Creating volume 5561a8ec-5958-4896-b47c-3ac8b98676c7 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:16:30 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:16:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:30 devstack sudo[83559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 1073741824 Apr 10 13:16:30 devstack sudo[83559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:31 devstack sudo[83559]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 1073741824" returned: 0 in 0.782s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:31 devstack sudo[83567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 Apr 10 13:16:31 devstack sudo[83567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:32 devstack sudo[83567]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7" returned: 0 in 1.112s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:16:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc608d34-e645-41b6-9a65-b5a5de2f6ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5561a8ec-5958-4896-b47c-3ac8b98676c7', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0318fb-a215-4cce-a627-f2edabb59192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:32 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Volume volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 (5561a8ec-5958-4896-b47c-3ac8b98676c7): created successfully Apr 10 13:16:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0318fb-a215-4cce-a627-f2edabb59192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Flow 'volume_create_manager' (2957970a-1b0a-4527-8ed2-83593321ff16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:16:32 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-449626b7-a8d5-47e6-816b-12667b2e653e tempest-DeleteServersTestJSON-1069798611 None] Created volume successfully. Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Flow 'volume_create_manager' (5ef75d2d-04a0-4102-a6f3-9ed1fb16a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0232c39c-fc6b-49a5-9e2e-2e482c545854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0232c39c-fc6b-49a5-9e2e-2e482c545854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:16:33Z,deleted=False,deleted_at=None,display_description='',display_name='6c32fcc2-deed-40f7-883b-2a3bebdd97b0-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce800ac-2731-40a5-be64-d5b4085922c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87326be55d3449e78e618db723c690f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:33Z,use_quota=True,user_id='1763290559a640cd8e173e29fb5dacc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b448a7-b2de-4d48-ba46-16ace1167ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b448a7-b2de-4d48-ba46-16ace1167ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be1f5a9-0fb7-44db-b1b0-004e9d5c753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be1f5a9-0fb7-44db-b1b0-004e9d5c753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce800ac-2731-40a5-be64-d5b4085922c3', 'volume_name': 'volume-dce800ac-2731-40a5-be64-d5b4085922c3', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742afba8-d142-4066-b03d-98edaac8d892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742afba8-d142-4066-b03d-98edaac8d892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814bda14-d5a6-4f99-a11f-aecb2655ebb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:33 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Volume dce800ac-2731-40a5-be64-d5b4085922c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce800ac-2731-40a5-be64-d5b4085922c3', 'volume_size': 1} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:16:33Z,deleted=False,deleted_at=None,display_description='',display_name='6c32fcc2-deed-40f7-883b-2a3bebdd97b0-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce800ac-2731-40a5-be64-d5b4085922c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87326be55d3449e78e618db723c690f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:33Z,use_quota=True,user_id='1763290559a640cd8e173e29fb5dacc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Creating volume dce800ac-2731-40a5-be64-d5b4085922c3 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:16:33 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:16:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:33 devstack sudo[83578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 1073741824 Apr 10 13:16:33 devstack sudo[83578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:33 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c5000b6b-d10f-480a-bff0-b08cfb50517b tempest-GroupSnapshotsTest-1760158676 None] Group tempest-GroupSnapshotsTest-Group-594789084: creating Apr 10 13:16:33 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c5000b6b-d10f-480a-bff0-b08cfb50517b tempest-GroupSnapshotsTest-1760158676 None] Group tempest-GroupSnapshotsTest-Group-594789084: created successfully Apr 10 13:16:33 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c5000b6b-d10f-480a-bff0-b08cfb50517b tempest-GroupSnapshotsTest-1760158676 None] Create group completed successfully. Apr 10 13:16:34 devstack sudo[83578]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 1073741824" returned: 0 in 0.852s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:34 devstack sudo[83584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 Apr 10 13:16:34 devstack sudo[83584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:35 devstack sudo[83584]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3" returned: 0 in 0.667s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814bda14-d5a6-4f99-a11f-aecb2655ebb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce800ac-2731-40a5-be64-d5b4085922c3', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a51b179-b7aa-43f5-bda4-dd1ac8570c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:35 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Volume volume-dce800ac-2731-40a5-be64-d5b4085922c3 (dce800ac-2731-40a5-be64-d5b4085922c3): created successfully Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a51b179-b7aa-43f5-bda4-dd1ac8570c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Flow 'volume_create_manager' (5ef75d2d-04a0-4102-a6f3-9ed1fb16a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:16:35 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-617106a1-408c-4c4d-a3b7-b298c287871a tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Created volume successfully. Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Flow 'volume_create_manager' (3d683d42-5851-47d8-81b3-94154f47d04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fdd1de-9ff3-49a0-8efd-e26299fa14b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fdd1de-9ff3-49a0-8efd-e26299fa14b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-680383606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddadf5a5-8506-4840-9ee5-04dcb500913e,host='devstack@QuobyteHD#QuobyteHD',id=646cdafc-76f3-4ba3-bbfa-d463c0f82a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49acedd7876e4a11a9618659ecca226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:35Z,use_quota=True,user_id='71b2a11ffa1a48baa67c5a41eb69f501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abb6f6f2-ade3-4333-b1eb-227c3b3e204b),volume_type_id=abb6f6f2-ade3-4333-b1eb-227c3b3e204b)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b8319c-4f78-4b1f-a6a1-eef7b1d312aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b8319c-4f78-4b1f-a6a1-eef7b1d312aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e94665e-1bc3-42f3-8597-2681cd5346e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e94665e-1bc3-42f3-8597-2681cd5346e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646cdafc-76f3-4ba3-bbfa-d463c0f82a69', 'volume_name': 'volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a6995d-4d59-4ee6-a75c-3fec9e2ec6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a6995d-4d59-4ee6-a75c-3fec9e2ec6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6bf26ca-7f28-4eb9-82c8-b904d5ad7fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:35 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Volume 646cdafc-76f3-4ba3-bbfa-d463c0f82a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69', 'volume_size': 1} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ddadf5a5-8506-4840-9ee5-04dcb500913e,created_at=2026-04-10T11:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-680383606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddadf5a5-8506-4840-9ee5-04dcb500913e,host='devstack@QuobyteHD#QuobyteHD',id=646cdafc-76f3-4ba3-bbfa-d463c0f82a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49acedd7876e4a11a9618659ecca226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:16:35Z,use_quota=True,user_id='71b2a11ffa1a48baa67c5a41eb69f501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abb6f6f2-ade3-4333-b1eb-227c3b3e204b),volume_type_id=abb6f6f2-ade3-4333-b1eb-227c3b3e204b)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Creating volume 646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:16:35 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:16:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:35 devstack sudo[83620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 1073741824 Apr 10 13:16:35 devstack sudo[83620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:36 devstack sudo[83620]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 1073741824" returned: 0 in 0.989s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:36 devstack sudo[83628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 Apr 10 13:16:36 devstack sudo[83628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:37 devstack sudo[83628]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" returned: 0 in 0.874s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6bf26ca-7f28-4eb9-82c8-b904d5ad7fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087c9792-6ae2-4878-a805-7d7db8f81021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:16:37 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Volume volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 (646cdafc-76f3-4ba3-bbfa-d463c0f82a69): created successfully Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087c9792-6ae2-4878-a805-7d7db8f81021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Flow 'volume_create_manager' (3d683d42-5851-47d8-81b3-94154f47d04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:16:37 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-77e0fa79-1874-46a3-9a35-9795abece5d8 tempest-GroupSnapshotsTest-1760158676 None] Created volume successfully. Apr 10 13:16:37 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] GroupSnapshot e1ab6855-3636-4bbf-a761-68be29a350c6: creating. Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Group snapshot e1ab6855-3636-4bbf-a761-68be29a350c6: creating. {{(pid=82554) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Creating offline snapshot b1cac383-cc44-48d8-9129-80c9aa883b88 of volume 646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee749430-89c9-47fd-b32e-d5bc5080013d]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:38 devstack sudo[83637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 Apr 10 13:16:38 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:38 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" returned: 0 in 1.016s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:39 devstack sudo[83650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 1G Apr 10 13:16:39 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:39 devstack cinder-volume[82554]: WARNING py.warnings [req-2743550a-81c6-493c-b38c-71b1b47457be req-15c54c65-5910-46cf-b03f-8f9e9d1c35e3 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 10 13:16:39 devstack cinder-volume[82554]: .first() Apr 10 13:16:39 devstack cinder-volume[82554]: Apr 10 13:16:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-3f5c759c-b027-4b03-9fd4-3451b265ee6c req-2f23b262-478e-403f-a5b6-5478bb2110c8 tempest-DeleteServersTestJSON-1069798611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-15c54c65-5910-46cf-b03f-8f9e9d1c35e3 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:39 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 1G" returned: 0 in 0.819s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:39 devstack sudo[83674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 Apr 10 13:16:39 devstack sudo[83674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:40 devstack sudo[83674]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88" returned: 0 in 0.486s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:40 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:16:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:40 devstack sudo[83680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 Apr 10 13:16:40 devstack sudo[83680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:40 devstack sudo[83680]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88" returned: 0 in 0.516s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:40 devstack sudo[83684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.info Apr 10 13:16:40 devstack sudo[83684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:41 devstack sudo[83684]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.info" returned: 0 in 0.535s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:41 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:16:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:41 devstack sudo[83688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.info Apr 10 13:16:41 devstack sudo[83688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:41 devstack sudo[83688]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.info" returned: 0 in 0.469s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.975s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-3f5c759c-b027-4b03-9fd4-3451b265ee6c req-2f23b262-478e-403f-a5b6-5478bb2110c8 tempest-DeleteServersTestJSON-1069798611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.408s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:41 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c0057b-7940-4083-aab3-fe5550611c62]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-3f5c759c-b027-4b03-9fd4-3451b265ee6c req-2f23b262-478e-403f-a5b6-5478bb2110c8 tempest-DeleteServersTestJSON-1069798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-19870ea4-cde5-4c2f-82f2-5f7f7fde467f tempest-GroupSnapshotsTest-1760158676 None] group_snapshot e1ab6855-3636-4bbf-a761-68be29a350c6: created successfully Apr 10 13:16:42 devstack sudo[83691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 Apr 10 13:16:42 devstack sudo[83691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:42 devstack sudo[83691]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-3f5c759c-b027-4b03-9fd4-3451b265ee6c req-2f23b262-478e-403f-a5b6-5478bb2110c8 tempest-DeleteServersTestJSON-1069798611 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7" returned: 0 in 0.609s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-3f5c759c-b027-4b03-9fd4-3451b265ee6c req-2f23b262-478e-403f-a5b6-5478bb2110c8 tempest-DeleteServersTestJSON-1069798611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.620s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-15c54c65-5910-46cf-b03f-8f9e9d1c35e3 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.026s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:42 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5dc064-8db7-400b-bc5f-33e25c790171]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-15c54c65-5910-46cf-b03f-8f9e9d1c35e3 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-3f5c759c-b027-4b03-9fd4-3451b265ee6c req-2f23b262-478e-403f-a5b6-5478bb2110c8 tempest-DeleteServersTestJSON-1069798611 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539', 'name': 'volume-5561a8ec-5958-4896-b47c-3ac8b98676c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a6c6e49-40a0-4696-802d-2683fd290aab', 'enforce_multipath': True} {{(pid=82554) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 13:16:42 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-3f5c759c-b027-4b03-9fd4-3451b265ee6c req-2f23b262-478e-403f-a5b6-5478bb2110c8 tempest-DeleteServersTestJSON-1069798611 None] attachment_update completed successfully. Apr 10 13:16:42 devstack sudo[83697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 Apr 10 13:16:42 devstack sudo[83697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:43 devstack sudo[83697]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-15c54c65-5910-46cf-b03f-8f9e9d1c35e3 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3" returned: 0 in 1.043s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-2743550a-81c6-493c-b38c-71b1b47457be req-15c54c65-5910-46cf-b03f-8f9e9d1c35e3 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.073s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-15c54c65-5910-46cf-b03f-8f9e9d1c35e3 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539', 'name': 'volume-dce800ac-2731-40a5-be64-d5b4085922c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3886f908-47d5-412b-81cc-99ca5783fc23', 'enforce_multipath': True} {{(pid=82554) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 13:16:43 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-2743550a-81c6-493c-b38c-71b1b47457be req-15c54c65-5910-46cf-b03f-8f9e9d1c35e3 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] attachment_update completed successfully. Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-b1cac383-cc44-48d8-9129-80c9aa883b88-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" by "_create_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-b1cac383-cc44-48d8-9129-80c9aa883b88-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Creating volume 7ccac3e2-670f-4df0-b54a-a0f8ec450d7b from snapshot b1cac383-cc44-48d8-9129-80c9aa883b88 {{(pid=82554) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] snapshot: b1cac383-cc44-48d8-9129-80c9aa883b88, volume: 7ccac3e2-670f-4df0-b54a-a0f8ec450d7b, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93d15b5-3f34-4be3-8fe6-8bd80ef8929d]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:44 devstack sudo[84088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 Apr 10 13:16:44 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:45 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88" returned: 0 in 0.817s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:16:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:16:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:16:45 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[29febcfd-ab9e-42e7-89ce-9077448f8396]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:45 devstack sudo[84094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 Apr 10 13:16:45 devstack sudo[84094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:45 devstack sudo[84094]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" returned: 0 in 0.644s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:46 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:16:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:46 devstack sudo[84099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b Apr 10 13:16:46 devstack sudo[84099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:50 devstack sudo[84099]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" returned: 0 in 4.498s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:50 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f2583c-6d43-44b0-b896-aaf9815233c5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:50 devstack sudo[84156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 Apr 10 13:16:50 devstack sudo[84156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:51 devstack sudo[84156]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" returned: 0 in 1.087s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:51 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:16:51 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Converted 1024.00 MB image at 227.59 MB/s Apr 10 13:16:51 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:16:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:51 devstack sudo[84186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b Apr 10 13:16:51 devstack sudo[84186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:52 devstack sudo[84186]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" returned: 0 in 0.569s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" released by "_copy_volume_from_snapshot" :: held 7.728s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-b1cac383-cc44-48d8-9129-80c9aa883b88-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" released by "_create_volume_from_snapshot" :: held 7.755s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.769s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:52 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-03ee31a0-4723-4276-b5cf-11c946189ff6 tempest-GroupSnapshotsTest-1760158676 None] Create group from source-snapshot-e1ab6855-3636-4bbf-a761-68be29a350c6 completed successfully. Apr 10 13:16:53 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-5ba29e5c-b47a-445f-947a-ea9c3149e924 req-4a11bac5-f86e-4874-a869-86e5c4dfa803 tempest-DeleteServersTestJSON-1069798611 None] Terminate volume connection completed successfully. Apr 10 13:16:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-5ba29e5c-b47a-445f-947a-ea9c3149e924 req-4a11bac5-f86e-4874-a869-86e5c4dfa803 tempest-DeleteServersTestJSON-1069798611 None] Deleting attachment 8a6c6e49-40a0-4696-802d-2683fd290aab. {{(pid=82554) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 13:16:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:53 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04e63ff-ab50-4d89-aa95-620530d56ea4]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:53 devstack sudo[84195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b Apr 10 13:16:53 devstack sudo[84195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:54 devstack sudo[84195]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" returned: 0 in 0.562s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:54 devstack sudo[84200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b Apr 10 13:16:54 devstack sudo[84200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:54 devstack sudo[84200]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" returned: 0 in 0.621s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-7ccac3e2-670f-4df0-b54a-a0f8ec450d7b" released by "delete_volume" :: held 1.205s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:55 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['dff4991f-98c0-4678-b42b-f613bc3fe426'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:16:55 devstack cinder-volume[82554]: WARNING cinder.quota [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-230060445 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-230060445, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:16:55 devstack cinder-volume[82554]: WARNING cinder.quota [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-230060445 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-230060445, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:16:55 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['1f8c0bb1-32ae-4eb9-be17-711b6053fe02', '96853c07-96e6-45a3-8c3b-a3e5ef8edac1', '60bdd026-e0e9-4fdc-8aca-6e2697ce4850', '8d98e9f0-f8e8-477f-8eec-2374a222b986'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:16:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:55 devstack sudo[84203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:16:55 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:55 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.531s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:55 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:16:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c0707069-a0ec-4a75-a49a-bbc9d37c8e73 tempest-GroupSnapshotsTest-1760158676 None] Delete group completed successfully. Apr 10 13:16:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] group_snapshot e1ab6855-3636-4bbf-a761-68be29a350c6: deleting Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] group_snapshot e1ab6855-3636-4bbf-a761-68be29a350c6: deleting {{(pid=82554) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-b1cac383-cc44-48d8-9129-80c9aa883b88" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-b1cac383-cc44-48d8-9129-80c9aa883b88" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Deleting offline snapshot b1cac383-cc44-48d8-9129-80c9aa883b88 of volume 646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] snapshot_file for this snap is: volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd593f3a-28a3-4e02-bf5d-c695ff2df5e5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:56 devstack sudo[84206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 Apr 10 13:16:56 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:56 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88" returned: 0 in 0.605s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[665b119e-0574-439a-9a47-f7bca876507b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:56 devstack sudo[84232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 Apr 10 13:16:56 devstack sudo[84232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Acquiring lock "cinder-5561a8ec-5958-4896-b47c-3ac8b98676c7-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Lock "cinder-5561a8ec-5958-4896-b47c-3ac8b98676c7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Acquiring lock "cinder-quobyte-5561a8ec-5958-4896-b47c-3ac8b98676c7" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Lock "cinder-quobyte-5561a8ec-5958-4896-b47c-3ac8b98676c7" acquired by "delete_volume" :: waited 0.015s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:57 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3f124d-3788-44a0-bf97-45b2650429ff]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:57 devstack sudo[84236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 Apr 10 13:16:57 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:57 devstack sudo[84232]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" returned: 0 in 0.770s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:57 devstack sudo[84242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 Apr 10 13:16:57 devstack sudo[84242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:57 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7" returned: 0 in 0.626s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:57 devstack sudo[84249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7 Apr 10 13:16:57 devstack sudo[84249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:58 devstack sudo[84242]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88" returned: 0 in 0.753s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:58 devstack sudo[84254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88 Apr 10 13:16:58 devstack sudo[84254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:58 devstack sudo[84249]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5561a8ec-5958-4896-b47c-3ac8b98676c7" returned: 0 in 0.906s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Lock "cinder-quobyte-5561a8ec-5958-4896-b47c-3ac8b98676c7" released by "delete_volume" :: held 1.576s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Created reservations ['e84fdb6c-198a-464c-85a8-e62db58f44d8', '28f4078f-15cc-432e-a245-fbd522845244', '40e4417f-14b5-4ad0-a838-939e348b2ac0', '60dccd20-0a86-4f8f-a114-9476a6036e4a'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:58 devstack sudo[84265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:16:58 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:16:58 devstack sudo[84254]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69.b1cac383-cc44-48d8-9129-80c9aa883b88" returned: 0 in 0.709s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-b1cac383-cc44-48d8-9129-80c9aa883b88" released by "_delete_snapshot" :: held 2.922s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" released by "delete_snapshot" :: held 2.933s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:59 devstack cinder-volume[82554]: WARNING cinder.quota [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-230060445 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-230060445, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:16:59 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['be3cce62-bc68-4dc8-a9ff-c3fbfb64e639', '7d2efde1-697b-4fb3-832f-5c8eb8839ade', '19539d51-c8c4-4fd1-92e9-81beb0409c55', '239df286-95c0-4320-92ee-53b2258cb2c7'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:16:59 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-387c0388-1a70-41d6-a71f-311d60604589 tempest-GroupSnapshotsTest-1760158676 None] group_snapshot e1ab6855-3636-4bbf-a761-68be29a350c6: deleted successfully Apr 10 13:16:59 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root Apr 10 13:16:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.502s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:16:59 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:16:59 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Deleted volume successfully. Apr 10 13:16:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-900085cf-92a7-4225-bcc8-9c4422963f39 tempest-DeleteServersTestJSON-1069798611 None] Lock "cinder-5561a8ec-5958-4896-b47c-3ac8b98676c7-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:16:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:16:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:16:59 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade020b4-f276-4020-934b-8e33fda2eca8]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:16:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:16:59 devstack sudo[84277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 Apr 10 13:16:59 devstack sudo[84277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:00 devstack sudo[84277]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" returned: 0 in 0.573s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:00 devstack sudo[84286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69 Apr 10 13:17:00 devstack sudo[84286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:00 devstack sudo[84286]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" returned: 0 in 0.516s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-646cdafc-76f3-4ba3-bbfa-d463c0f82a69" released by "delete_volume" :: held 1.120s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['d2dc31c4-c2b0-4a27-a1b9-683483474d64'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:17:00 devstack cinder-volume[82554]: WARNING cinder.db.sqlalchemy.api [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-230060445'] Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['1c69305f-a78e-4030-88b3-befc29c5a9ff', 'aa942c8f-3eba-443d-86aa-6ae42cbca536', 'aa322b2a-80bc-43aa-ad5c-fb3ee6f115b6', '50c9eb24-b409-4834-9c6e-7c10e9111e7f'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:00 devstack sudo[84292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:17:00 devstack sudo[84292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:01 devstack sudo[84292]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.452s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:01 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:17:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ddc6b860-a23e-42d2-b537-9d7f120e3d0e tempest-GroupSnapshotsTest-1760158676 None] Delete group completed successfully. Apr 10 13:17:02 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ebf7bdb7-dd30-435f-aca6-9520ad4dd68f tempest-GroupSnapshotsTest-1760158676 None] Group tempest-GroupSnapshotsTest-Group-778359208: creating Apr 10 13:17:02 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ebf7bdb7-dd30-435f-aca6-9520ad4dd68f tempest-GroupSnapshotsTest-1760158676 None] Group tempest-GroupSnapshotsTest-Group-778359208: created successfully Apr 10 13:17:02 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ebf7bdb7-dd30-435f-aca6-9520ad4dd68f tempest-GroupSnapshotsTest-1760158676 None] Create group completed successfully. Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Flow 'volume_create_manager' (fdeaf7c1-0839-4f21-a5cd-618d7d515771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d91635-97cb-4d26-9d24-e6b30af5a620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d91635-97cb-4d26-9d24-e6b30af5a620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-131020567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cebc6f1d-8000-48c7-a262-0338dd53cf33,host='devstack@QuobyteHD#QuobyteHD',id=116fe9cf-ed24-41a9-8685-4164ab37e6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49acedd7876e4a11a9618659ecca226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:04Z,use_quota=True,user_id='71b2a11ffa1a48baa67c5a41eb69f501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6d83419-0c33-43e3-b443-794c14b6d116),volume_type_id=c6d83419-0c33-43e3-b443-794c14b6d116)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1202b33d-a6cd-4992-a996-f47633dcc476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1202b33d-a6cd-4992-a996-f47633dcc476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e127ff8-99e0-4dcb-b294-e72b270003f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e127ff8-99e0-4dcb-b294-e72b270003f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '116fe9cf-ed24-41a9-8685-4164ab37e6b9', 'volume_name': 'volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92421998-29df-429d-ba2a-e13519517766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92421998-29df-429d-ba2a-e13519517766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9077a231-f457-455a-b4f4-b2d83acba640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:03 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Volume 116fe9cf-ed24-41a9-8685-4164ab37e6b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9', 'volume_size': 1} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cebc6f1d-8000-48c7-a262-0338dd53cf33,created_at=2026-04-10T11:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-131020567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cebc6f1d-8000-48c7-a262-0338dd53cf33,host='devstack@QuobyteHD#QuobyteHD',id=116fe9cf-ed24-41a9-8685-4164ab37e6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49acedd7876e4a11a9618659ecca226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:04Z,use_quota=True,user_id='71b2a11ffa1a48baa67c5a41eb69f501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6d83419-0c33-43e3-b443-794c14b6d116),volume_type_id=c6d83419-0c33-43e3-b443-794c14b6d116)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Creating volume 116fe9cf-ed24-41a9-8685-4164ab37e6b9 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:17:03 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:17:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:03 devstack sudo[84351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 1073741824 Apr 10 13:17:03 devstack sudo[84351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:04 devstack sudo[84351]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 1073741824" returned: 0 in 0.729s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:04 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:UPDATE=85,cinder:SELECT=91,cinder:INSERT=14,cinder:DELETE=2 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:17:04 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=82,cinder:UPDATE=80,cinder:INSERT=23,cinder:DELETE=7 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:17:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:04 devstack sudo[84358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 Apr 10 13:17:04 devstack sudo[84358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:05 devstack sudo[84358]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9" returned: 0 in 0.642s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:17:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9077a231-f457-455a-b4f4-b2d83acba640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de93ab96-b0fa-46f7-bc96-ecd4b3f91fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:05 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Volume volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 (116fe9cf-ed24-41a9-8685-4164ab37e6b9): created successfully Apr 10 13:17:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de93ab96-b0fa-46f7-bc96-ecd4b3f91fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Flow 'volume_create_manager' (fdeaf7c1-0839-4f21-a5cd-618d7d515771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:05 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-41897233-6e49-4f96-b546-a2aca4d4e9a8 tempest-GroupSnapshotsTest-1760158676 None] Created volume successfully. Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Flow 'volume_create_manager' (76b04362-1520-40d9-9123-4ee96b2d5270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584d5314-9199-4cd4-828c-e31e834bafb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584d5314-9199-4cd4-828c-e31e834bafb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1441205622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cebc6f1d-8000-48c7-a262-0338dd53cf33,host='devstack@QuobyteHD#QuobyteHD',id=a2ec7abb-6bbe-4ee0-9900-325eb08a9c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49acedd7876e4a11a9618659ecca226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:06Z,use_quota=True,user_id='71b2a11ffa1a48baa67c5a41eb69f501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6d83419-0c33-43e3-b443-794c14b6d116),volume_type_id=c6d83419-0c33-43e3-b443-794c14b6d116)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b604062-ab4a-45c4-9541-8fa12197bbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b604062-ab4a-45c4-9541-8fa12197bbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a39489c-75f0-40a8-97fa-e622568cbf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a39489c-75f0-40a8-97fa-e622568cbf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ec7abb-6bbe-4ee0-9900-325eb08a9c21', 'volume_name': 'volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bd9f32-aff5-497c-9ac2-0e908bfe1cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bd9f32-aff5-497c-9ac2-0e908bfe1cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489a0733-c412-48a4-a5c4-5f166e6758db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:06 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Volume a2ec7abb-6bbe-4ee0-9900-325eb08a9c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21', 'volume_size': 1} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cebc6f1d-8000-48c7-a262-0338dd53cf33,created_at=2026-04-10T11:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1441205622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cebc6f1d-8000-48c7-a262-0338dd53cf33,host='devstack@QuobyteHD#QuobyteHD',id=a2ec7abb-6bbe-4ee0-9900-325eb08a9c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49acedd7876e4a11a9618659ecca226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:06Z,use_quota=True,user_id='71b2a11ffa1a48baa67c5a41eb69f501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6d83419-0c33-43e3-b443-794c14b6d116),volume_type_id=c6d83419-0c33-43e3-b443-794c14b6d116)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Creating volume a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:17:06 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:17:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:06 devstack sudo[84368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 1073741824 Apr 10 13:17:06 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:07 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 1073741824" returned: 0 in 0.647s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:07 devstack sudo[84385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 Apr 10 13:17:07 devstack sudo[84385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:07 devstack sudo[84385]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" returned: 0 in 0.607s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:17:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489a0733-c412-48a4-a5c4-5f166e6758db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faeabcef-21e7-48dc-bcbb-9784bbe1b1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:07 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Volume volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 (a2ec7abb-6bbe-4ee0-9900-325eb08a9c21): created successfully Apr 10 13:17:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faeabcef-21e7-48dc-bcbb-9784bbe1b1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Flow 'volume_create_manager' (76b04362-1520-40d9-9123-4ee96b2d5270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:07 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6ad74b27-803b-4378-89c1-caa0e4b7aab8 tempest-GroupSnapshotsTest-1760158676 None] Created volume successfully. Apr 10 13:17:08 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7c1057ad-f8c8-4e38-8930-a98e810ad36b tempest-GroupSnapshotsTest-1760158676 None] Update group completed successfully. Apr 10 13:17:09 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2ffabbeb-468f-4b92-a691-67c7db23bc97 tempest-GroupSnapshotsTest-1760158676 None] Update group completed successfully. Apr 10 13:17:11 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0b879085-6f06-4a95-9f17-d443b16ebf69 tempest-GroupSnapshotsTest-1760158676 None] Update group completed successfully. Apr 10 13:17:12 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-33d66e67-5725-4208-8cb7-388e801ac5ab tempest-GroupSnapshotsTest-1760158676 None] Update group completed successfully. Apr 10 13:17:13 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] GroupSnapshot d4c46c0e-d87c-4bf2-b59a-a0cb73bac231: creating. Apr 10 13:17:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Group snapshot d4c46c0e-d87c-4bf2-b59a-a0cb73bac231: creating. {{(pid=82554) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 13:17:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Creating offline snapshot 172acf48-8bd8-44ac-9e94-e94f21ad5307 of volume a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:17:13 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc2b206-6d2c-4830-9791-1d6ee8571e8a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:13 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 Apr 10 13:17:13 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:14 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" returned: 0 in 0.711s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:14 devstack sudo[84487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 1G Apr 10 13:17:14 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:15 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 1G" returned: 0 in 0.918s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:15 devstack sudo[84500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 Apr 10 13:17:15 devstack sudo[84500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:15 devstack sudo[84500]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307" returned: 0 in 0.602s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:15 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:17:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:15 devstack sudo[84507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 Apr 10 13:17:15 devstack sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:16 devstack sudo[84507]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307" returned: 0 in 0.496s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:16 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.info Apr 10 13:17:16 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:17 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.info" returned: 0 in 0.587s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:17 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:17:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:17 devstack sudo[84529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.info Apr 10 13:17:17 devstack sudo[84529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:17 devstack sudo[84529]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.info" returned: 0 in 0.483s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.901s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Creating offline snapshot aace48a7-9204-4f92-aad2-3fb5fc1c3946 of volume 116fe9cf-ed24-41a9-8685-4164ab37e6b9 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:17:17 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[604c1f8b-b80f-405f-abfb-90f0ea5ce676]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:17 devstack sudo[84534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 Apr 10 13:17:17 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:18 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9" returned: 0 in 0.784s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:18 devstack sudo[84542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 1G Apr 10 13:17:18 devstack sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:18 devstack sudo[84542]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 1G" returned: 0 in 0.566s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:18 devstack sudo[84547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 Apr 10 13:17:19 devstack sudo[84547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:19 devstack sudo[84547]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946" returned: 0 in 0.624s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:19 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:17:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:19 devstack sudo[84552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 Apr 10 13:17:19 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:20 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946" returned: 0 in 0.533s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:20 devstack sudo[84570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.info Apr 10 13:17:20 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:20 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.info" returned: 0 in 0.511s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:20 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:17:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:20 devstack sudo[84576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.info Apr 10 13:17:20 devstack sudo[84576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:21 devstack sudo[84576]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.info" returned: 0 in 0.604s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.701s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:21 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-e61913a5-934b-47c5-beb6-c30299c6f920 tempest-GroupSnapshotsTest-1760158676 None] group_snapshot d4c46c0e-d87c-4bf2-b59a-a0cb73bac231: created successfully Apr 10 13:17:22 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] group_snapshot d4c46c0e-d87c-4bf2-b59a-a0cb73bac231: deleting Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] group_snapshot d4c46c0e-d87c-4bf2-b59a-a0cb73bac231: deleting {{(pid=82554) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-172acf48-8bd8-44ac-9e94-e94f21ad5307" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-172acf48-8bd8-44ac-9e94-e94f21ad5307" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Deleting offline snapshot 172acf48-8bd8-44ac-9e94-e94f21ad5307 of volume a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] snapshot_file for this snap is: volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b9642-9751-4e12-b224-7cf3c7cc9339]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:22 devstack sudo[84583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 Apr 10 13:17:22 devstack sudo[84583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG oslo_service.periodic_task [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82554) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:22 devstack sudo[84586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:17:22 devstack sudo[84586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:23 devstack sudo[84586]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.613s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:23 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:17:23 devstack sudo[84583]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307" returned: 0 in 0.820s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:23 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:17:23 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c1034e-ecf8-40c8-8b6c-a49736dbb9ef]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:23 devstack sudo[84606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 Apr 10 13:17:23 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:23 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" returned: 0 in 0.754s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:24 devstack sudo[84614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 Apr 10 13:17:24 devstack sudo[84614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:24 devstack sudo[84614]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307" returned: 0 in 0.670s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:24 devstack sudo[84621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307 Apr 10 13:17:24 devstack sudo[84621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:25 devstack sudo[84621]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21.172acf48-8bd8-44ac-9e94-e94f21ad5307" returned: 0 in 0.734s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-172acf48-8bd8-44ac-9e94-e94f21ad5307" released by "_delete_snapshot" :: held 3.068s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" released by "delete_snapshot" :: held 3.081s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-116fe9cf-ed24-41a9-8685-4164ab37e6b9" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-116fe9cf-ed24-41a9-8685-4164ab37e6b9" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-aace48a7-9204-4f92-aad2-3fb5fc1c3946" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-aace48a7-9204-4f92-aad2-3fb5fc1c3946" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Deleting offline snapshot aace48a7-9204-4f92-aad2-3fb5fc1c3946 of volume 116fe9cf-ed24-41a9-8685-4164ab37e6b9 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] snapshot_file for this snap is: volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a260073-298d-43c9-954c-ea365e92dd48]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:25 devstack sudo[84665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 Apr 10 13:17:25 devstack sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:26 devstack sudo[84665]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946" returned: 0 in 0.636s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:17:26 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcb7b4e-7849-4bb2-9b04-09a14b76574e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:26 devstack sudo[84673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 Apr 10 13:17:26 devstack sudo[84673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:26 devstack sudo[84673]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9" returned: 0 in 0.596s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:26 devstack sudo[84680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 Apr 10 13:17:26 devstack sudo[84680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:27 devstack sudo[84680]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946" returned: 0 in 1.129s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:27 devstack sudo[84709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946 Apr 10 13:17:27 devstack sudo[84709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:28 devstack sudo[84709]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9.aace48a7-9204-4f92-aad2-3fb5fc1c3946" returned: 0 in 0.835s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-aace48a7-9204-4f92-aad2-3fb5fc1c3946" released by "_delete_snapshot" :: held 3.288s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:17:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-116fe9cf-ed24-41a9-8685-4164ab37e6b9" released by "delete_snapshot" :: held 3.318s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:17:29 devstack cinder-volume[82554]: WARNING cinder.quota [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1756881232 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1756881232, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:17:29 devstack cinder-volume[82554]: WARNING cinder.quota [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1756881232 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1756881232, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:17:29 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['4d20f6e0-973d-4103-9db6-bac3e994966a', '926bcccb-0601-4d20-b281-bc2a9a843434', '0ca03160-8f84-466d-bd24-0923ba52ce55', '2398a264-5780-4a5d-b207-bf8ae9203b71'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:17:29 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['e75f44b7-e6e9-4a3f-811c-197b7b8ff5f2', '2a7f945d-ed76-4f7c-b132-44d053b8bb4c', '052ac231-03d1-41ea-92c1-39b68124a97f', '76adecd2-bc52-4dd0-887d-501aa5aa2e21'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:17:29 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6ff708d8-69a6-4bb3-b28b-87f57935476e tempest-GroupSnapshotsTest-1760158676 None] group_snapshot d4c46c0e-d87c-4bf2-b59a-a0cb73bac231: deleted successfully Apr 10 13:17:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-116fe9cf-ed24-41a9-8685-4164ab37e6b9" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:17:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-116fe9cf-ed24-41a9-8685-4164ab37e6b9" acquired by "delete_volume" :: waited 0.023s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:17:31 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5631f685-10ee-43c0-90d2-dd976031bea2]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:31 devstack sudo[84767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 Apr 10 13:17:31 devstack sudo[84767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:32 devstack sudo[84767]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9" returned: 0 in 1.067s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:32 devstack sudo[84775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9 Apr 10 13:17:32 devstack sudo[84775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:33 devstack sudo[84775]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-116fe9cf-ed24-41a9-8685-4164ab37e6b9" returned: 0 in 0.698s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-116fe9cf-ed24-41a9-8685-4164ab37e6b9" released by "delete_volume" :: held 1.905s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:17:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:17:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" acquired by "delete_volume" :: waited 0.015s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:17:33 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2834f3-0f47-41eb-9cde-1deddf1ea552]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:33 devstack sudo[84778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 Apr 10 13:17:33 devstack sudo[84778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:34 devstack sudo[84778]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" returned: 0 in 0.808s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:34 devstack sudo[84784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21 Apr 10 13:17:34 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:34 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" returned: 0 in 0.600s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-a2ec7abb-6bbe-4ee0-9900-325eb08a9c21" released by "delete_volume" :: held 1.597s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:17:35 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['e9f4e253-c319-4842-9dc9-f9330d32074f'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:17:35 devstack cinder-volume[82554]: WARNING cinder.quota [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1756881232 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1756881232, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:17:35 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['e510eb1b-390d-4917-941a-79271ff8ad14', 'fd90298c-e055-4d75-9d82-00256d32c6d3', 'aac329cc-2601-461b-adc9-c8524a3e58e6', '8c339943-32bd-4ec4-acf5-47c29855af96'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:17:35 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['31f69ea4-d9ef-49c3-a9f0-092dd5638758', '4cb36714-a1b5-457b-bb93-612562fb74e9', '336e5909-39f0-4c53-888c-dba89a4bed52', '3de01381-7901-4c68-8718-60703b699b1d'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:17:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:17:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:17:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:35 devstack sudo[84808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:17:35 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:36 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 1.144s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:36 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:17:36 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6432e47c-54f7-4849-ba3f-b2c1e201a079 tempest-GroupSnapshotsTest-1760158676 None] Delete group completed successfully. Apr 10 13:17:36 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8d68957a-0db4-4b94-8449-f63bcf712e7a tempest-GroupSnapshotsTest-1760158676 None] Group tempest-GroupSnapshotsTest-Group-1096156550: creating Apr 10 13:17:36 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8d68957a-0db4-4b94-8449-f63bcf712e7a tempest-GroupSnapshotsTest-1760158676 None] Group tempest-GroupSnapshotsTest-Group-1096156550: created successfully Apr 10 13:17:36 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8d68957a-0db4-4b94-8449-f63bcf712e7a tempest-GroupSnapshotsTest-1760158676 None] Create group completed successfully. Apr 10 13:17:38 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Flow 'volume_create_manager' (88139c26-5fb1-422d-8c46-16374c661ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4171d69e-9445-48a7-8e56-bd425ab268e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4171d69e-9445-48a7-8e56-bd425ab268e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1721896325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=919a6fe0-9c7d-498c-89de-4961d6f38c89,host='devstack@QuobyteHD#QuobyteHD',id=b770dcb2-3872-4932-82da-b2cea2637f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49acedd7876e4a11a9618659ecca226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:39Z,use_quota=True,user_id='71b2a11ffa1a48baa67c5a41eb69f501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba1412f4-6f5d-4cbe-9d23-1a90748a3c64),volume_type_id=ba1412f4-6f5d-4cbe-9d23-1a90748a3c64)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af0d5cc-6fdb-4072-8554-5bf993e26d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af0d5cc-6fdb-4072-8554-5bf993e26d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6f380d-7617-4bf7-b71b-1cc5a0297657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6f380d-7617-4bf7-b71b-1cc5a0297657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b770dcb2-3872-4932-82da-b2cea2637f35', 'volume_name': 'volume-b770dcb2-3872-4932-82da-b2cea2637f35', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29045624-d31c-498d-8173-df0dd37faa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29045624-d31c-498d-8173-df0dd37faa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331c6501-100c-408c-a7f9-645c88a7467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Volume b770dcb2-3872-4932-82da-b2cea2637f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b770dcb2-3872-4932-82da-b2cea2637f35', 'volume_size': 1} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=919a6fe0-9c7d-498c-89de-4961d6f38c89,created_at=2026-04-10T11:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1721896325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=919a6fe0-9c7d-498c-89de-4961d6f38c89,host='devstack@QuobyteHD#QuobyteHD',id=b770dcb2-3872-4932-82da-b2cea2637f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49acedd7876e4a11a9618659ecca226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:39Z,use_quota=True,user_id='71b2a11ffa1a48baa67c5a41eb69f501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba1412f4-6f5d-4cbe-9d23-1a90748a3c64),volume_type_id=ba1412f4-6f5d-4cbe-9d23-1a90748a3c64)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Creating volume b770dcb2-3872-4932-82da-b2cea2637f35 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:17:39 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:17:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:39 devstack sudo[84922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 1073741824 Apr 10 13:17:39 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:40 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 1073741824" returned: 0 in 1.185s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:40 devstack sudo[84932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 Apr 10 13:17:40 devstack sudo[84932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:41 devstack sudo[84932]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35" returned: 0 in 0.635s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:17:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331c6501-100c-408c-a7f9-645c88a7467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b770dcb2-3872-4932-82da-b2cea2637f35', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a7db3d-ef03-40fc-8895-a9e20d8c09dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:41 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Volume volume-b770dcb2-3872-4932-82da-b2cea2637f35 (b770dcb2-3872-4932-82da-b2cea2637f35): created successfully Apr 10 13:17:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a7db3d-ef03-40fc-8895-a9e20d8c09dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Flow 'volume_create_manager' (88139c26-5fb1-422d-8c46-16374c661ec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7579265a-da7f-4546-b5e0-762134202d68 tempest-GroupSnapshotsTest-1760158676 None] Created volume successfully. Apr 10 13:17:42 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] GroupSnapshot a70ff948-60ba-4298-8e4f-ee24aec70688: creating. Apr 10 13:17:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Group snapshot a70ff948-60ba-4298-8e4f-ee24aec70688: creating. {{(pid=82554) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 13:17:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Creating offline snapshot 51f75992-999b-4161-b620-8ea305d31cad of volume b770dcb2-3872-4932-82da-b2cea2637f35 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:17:42 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1f069c-6bd3-49b7-9895-d2d7d92074bc]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:42 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 Apr 10 13:17:42 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:44 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35" returned: 0 in 1.456s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:44 devstack sudo[85016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad 1G Apr 10 13:17:44 devstack sudo[85016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:45 devstack sudo[85016]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad 1G" returned: 0 in 1.627s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b770dcb2-3872-4932-82da-b2cea2637f35 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:45 devstack sudo[85031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b770dcb2-3872-4932-82da-b2cea2637f35 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad Apr 10 13:17:45 devstack sudo[85031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:46 devstack sudo[85031]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b770dcb2-3872-4932-82da-b2cea2637f35 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad" returned: 0 in 1.015s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:46 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:17:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:46 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad Apr 10 13:17:46 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Flow 'volume_create_manager' (09b2954b-e4e7-476b-9bfc-24caa8e46201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621f7971-c9e9-4cef-8ac7-83895096d026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621f7971-c9e9-4cef-8ac7-83895096d026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1269342981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9dad68-2be1-4ac7-b084-756c9c7928ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='121770ce7d4045b3b72cf41ca1015869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:47Z,use_quota=True,user_id='8f8382ede0df47bc91593f1e76909ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cba713-4032-40fb-a9d4-bd81335323d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cba713-4032-40fb-a9d4-bd81335323d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e356fc56-b916-4964-a28f-e3cb859b5f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e356fc56-b916-4964-a28f-e3cb859b5f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9dad68-2be1-4ac7-b084-756c9c7928ca', 'volume_name': 'volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:47 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b454bfc0-f701-4e4f-837b-8b6deb588ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b454bfc0-f701-4e4f-837b-8b6deb588ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b48e43-f8cd-4d5f-88a1-a121f1fd9565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:47 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Volume fd9dad68-2be1-4ac7-b084-756c9c7928ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca', 'volume_size': 1} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad" returned: 0 in 1.088s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:48 devstack sudo[85041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.info Apr 10 13:17:48 devstack sudo[85041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:48 devstack sudo[85041]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.info" returned: 0 in 1.033s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:48 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:17:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:48 devstack sudo[85044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.info Apr 10 13:17:48 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:49 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:17:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Flow 'volume_create_manager' (f0579a2d-168a-4bb3-bdbb-4cb10e7bfbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8602ab4b-3bfb-4bde-b9b6-5f9d7b22d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8602ab4b-3bfb-4bde-b9b6-5f9d7b22d920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834daac8-0b51-4fc0-bb89-70cc05b51c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87326be55d3449e78e618db723c690f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:50Z,use_quota=True,user_id='1763290559a640cd8e173e29fb5dacc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2935cf-8a96-47eb-8281-8fbc5b4b89dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2935cf-8a96-47eb-8281-8fbc5b4b89dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bf14f0-ecae-4684-95ef-334c3239446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:49 devstack cinder-volume[82554]: DEBUG cinder.image.glance [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Creating Keystone auth plugin from conf {{(pid=82554) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bf14f0-ecae-4684-95ef-334c3239446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '834daac8-0b51-4fc0-bb89-70cc05b51c56', 'volume_name': 'volume-834daac8-0b51-4fc0-bb89-70cc05b51c56', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99eb2320-52f7-47d1-af6c-7a0aa0f0fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99eb2320-52f7-47d1-af6c-7a0aa0f0fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26935319-9e9a-4003-8c55-1ada45b03403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:50 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Volume 834daac8-0b51-4fc0-bb89-70cc05b51c56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-834daac8-0b51-4fc0-bb89-70cc05b51c56', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Trying to clone 834daac8-0b51-4fc0-bb89-70cc05b51c56 from image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]). {{(pid=82554) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 13:17:50 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.info" returned: 0 in 1.584s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.992s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.751s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1269342981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9dad68-2be1-4ac7-b084-756c9c7928ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='121770ce7d4045b3b72cf41ca1015869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:47Z,use_quota=True,user_id='8f8382ede0df47bc91593f1e76909ff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Creating volume fd9dad68-2be1-4ac7-b084-756c9c7928ca {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:17:50 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:17:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:50 devstack sudo[85049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca 1073741824 Apr 10 13:17:50 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:50 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-64207c1f-09a5-447f-adf0-6aedffbefb4f tempest-GroupSnapshotsTest-1760158676 None] group_snapshot a70ff948-60ba-4298-8e4f-ee24aec70688: created successfully Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 13:17:51 devstack cinder-volume[82554]: INFO cinder.image.image_utils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Image download 20.69 MB at 20.69 MB/s Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46ea00f-9fd9-45d4-a55d-5be3df2bf082]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:51 devstack sudo[85074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD Apr 10 13:17:51 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:51 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] group_snapshot a70ff948-60ba-4298-8e4f-ee24aec70688: deleting Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] group_snapshot a70ff948-60ba-4298-8e4f-ee24aec70688: deleting {{(pid=82554) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-b770dcb2-3872-4932-82da-b2cea2637f35" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-b770dcb2-3872-4932-82da-b2cea2637f35" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-51f75992-999b-4161-b620-8ea305d31cad" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-51f75992-999b-4161-b620-8ea305d31cad" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Deleting offline snapshot 51f75992-999b-4161-b620-8ea305d31cad of volume b770dcb2-3872-4932-82da-b2cea2637f35 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] snapshot_file for this snap is: volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[879e1cd0-a713-4617-aef1-ce78531344ac]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:17:52 devstack sudo[85079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad Apr 10 13:17:52 devstack sudo[85079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Flow 'volume_create_manager' (05356c42-de44-4f0c-a2e5-fc6434b3b1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87187e13-9c19-4512-b141-32afbcd630b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:52 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD" returned: 0 in 1.103s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Temporary image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d is fetched for user 1763290559a640cd8e173e29fb5dacc1. {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87187e13-9c19-4512-b141-32afbcd630b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1075253057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07eae33c-bcfb-40ae-b1fd-773d779afa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea8d5ce8584bc59bbd6db0200de2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:52Z,use_quota=True,user_id='fc4a56b380fb4612b5da8c4bdfbed64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fce4ac4-f7ac-4fb3-8edc-564794036952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fce4ac4-f7ac-4fb3-8edc-564794036952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8ccdd2-1b60-4556-9244-3829417d959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8ccdd2-1b60-4556-9244-3829417d959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07eae33c-bcfb-40ae-b1fd-773d779afa4a', 'volume_name': 'volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ddf3cd-388b-4400-830d-7c3701d7a00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ddf3cd-388b-4400-830d-7c3701d7a00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57168fa-863b-4b6d-8a9a-9ea4cbf53737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:52 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Volume 07eae33c-bcfb-40ae-b1fd-773d779afa4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a', 'volume_size': 1} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a96b7-b8a6-4632-80e2-7bfabfbfec40]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:52 devstack sudo[85084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD Apr 10 13:17:52 devstack sudo[85084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:52 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca 1073741824" returned: 0 in 1.976s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:52 devstack sudo[85086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca Apr 10 13:17:52 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:53 devstack sudo[85079]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad" returned: 0 in 1.448s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b770dcb2-3872-4932-82da-b2cea2637f35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff0d3ba-016d-4f42-929c-f37e5041df29]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:53 devstack sudo[85094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 Apr 10 13:17:53 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:53 devstack sudo[85084]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD" returned: 0 in 1.299s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:53 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca" returned: 0 in 1.196s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] <== create_volume: return (3218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.227s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1075253057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07eae33c-bcfb-40ae-b1fd-773d779afa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea8d5ce8584bc59bbd6db0200de2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:52Z,use_quota=True,user_id='fc4a56b380fb4612b5da8c4bdfbed64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Creating volume 07eae33c-bcfb-40ae-b1fd-773d779afa4a {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:17:53 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b48e43-f8cd-4d5f-88a1-a121f1fd9565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3e5085-186d-4bdf-8fb5-59836fd3ad78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:53 devstack sudo[85097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a 1073741824 Apr 10 13:17:53 devstack sudo[85097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:53 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Volume volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca (fd9dad68-2be1-4ac7-b084-756c9c7928ca): created successfully Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3e5085-186d-4bdf-8fb5-59836fd3ad78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Flow 'volume_create_manager' (09b2954b-e4e7-476b-9bfc-24caa8e46201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:53 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-cfafb24f-29c8-48a6-8ce2-8652534a3303 tempest-ServerRescueNegativeTestJSON-1751887214 None] Created volume successfully. Apr 10 13:17:54 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35" returned: 0 in 0.915s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:54 devstack sudo[85103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad Apr 10 13:17:54 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:55 devstack sudo[85097]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a 1073741824" returned: 0 in 1.310s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:55 devstack sudo[85111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a Apr 10 13:17:55 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:55 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad" returned: 0 in 1.005s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:55 devstack sudo[85113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad Apr 10 13:17:55 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:55 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a" returned: 0 in 0.791s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.261s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834daac8-0b51-4fc0-bb89-70cc05b51c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87326be55d3449e78e618db723c690f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:50Z,use_quota=True,user_id='1763290559a640cd8e173e29fb5dacc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Creating volume 834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:17:56 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:56 devstack sudo[85117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 1073741824 Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57168fa-863b-4b6d-8a9a-9ea4cbf53737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700e3f56-8a73-4641-96bf-27b64f685d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:56 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:56 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Volume volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a (07eae33c-bcfb-40ae-b1fd-773d779afa4a): created successfully Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700e3f56-8a73-4641-96bf-27b64f685d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Flow 'volume_create_manager' (05356c42-de44-4f0c-a2e5-fc6434b3b1df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:56 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-19a12c8e-f514-469b-bb7f-d2498cece534 tempest-ServersNegativeTestJSON-1660561081 None] Created volume successfully. Apr 10 13:17:56 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35.51f75992-999b-4161-b620-8ea305d31cad" returned: 0 in 0.759s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-51f75992-999b-4161-b620-8ea305d31cad" released by "_delete_snapshot" :: held 4.360s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-b770dcb2-3872-4932-82da-b2cea2637f35" released by "delete_snapshot" :: held 4.391s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:17:56 devstack cinder-volume[82554]: WARNING cinder.quota [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-379662085 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-379662085, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:17:56 devstack cinder-volume[82554]: WARNING cinder.quota [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-379662085 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-379662085, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:17:56 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['609baa5a-672c-4a19-b202-112f23e40d56', 'a3e73b16-8df3-4499-957b-aa9f3153d920', '0a3c7e60-1e6b-4404-a2f0-b73ea6c8e882', '51549f7e-63b6-4f79-84ae-71fe26ae87a6'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:17:56 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4f738089-008c-428e-aa62-d5712664677b tempest-GroupSnapshotsTest-1760158676 None] group_snapshot a70ff948-60ba-4298-8e4f-ee24aec70688: deleted successfully Apr 10 13:17:57 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 1073741824" returned: 0 in 1.574s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:57 devstack sudo[85122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 Apr 10 13:17:57 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "cinder-quobyte-b770dcb2-3872-4932-82da-b2cea2637f35" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-b770dcb2-3872-4932-82da-b2cea2637f35" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fca3d2-02ca-4975-a220-ad4cb2a14748]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:58 devstack sudo[85126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 Apr 10 13:17:58 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:58 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56" returned: 0 in 0.998s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] <== create_volume: return (2619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.650s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Flow 'volume_create_manager' (a4358edc-2901-4005-b269-93a38955d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7e90c8-291e-4444-a795-d5bc83a9b1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7e90c8-291e-4444-a795-d5bc83a9b1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-491372755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24214b98-6e64-4ca8-b88f-cda77d902598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea8d5ce8584bc59bbd6db0200de2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:59Z,use_quota=True,user_id='fc4a56b380fb4612b5da8c4bdfbed64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80336bc6-5076-45ac-803e-2e4c54436ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80336bc6-5076-45ac-803e-2e4c54436ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62734313-f5c9-4027-9620-c567878ef96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62734313-f5c9-4027-9620-c567878ef96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24214b98-6e64-4ca8-b88f-cda77d902598', 'volume_name': 'volume-24214b98-6e64-4ca8-b88f-cda77d902598', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4843b2e-e31c-4c72-ae3b-bb6f3c42eabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4843b2e-e31c-4c72-ae3b-bb6f3c42eabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d452d7c-603c-4544-a45d-2546b24ebcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:17:58 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Volume 24214b98-6e64-4ca8-b88f-cda77d902598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24214b98-6e64-4ca8-b88f-cda77d902598', 'volume_size': 1} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-491372755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24214b98-6e64-4ca8-b88f-cda77d902598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea8d5ce8584bc59bbd6db0200de2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:17:59Z,use_quota=True,user_id='fc4a56b380fb4612b5da8c4bdfbed64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Creating volume 24214b98-6e64-4ca8-b88f-cda77d902598 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:17:58 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:58 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598 1073741824 Apr 10 13:17:58 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:58 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Attempting download of 4ccac92a-bf64-4e00-af7f-9898d1d98b1d ((None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}])) to volume 834daac8-0b51-4fc0-bb89-70cc05b51c56. {{(pid=82554) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 13:17:59 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea23ed5-792c-4ca0-90b6-d506e7d29f1a]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:17:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_xeh4_ynj {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:59 devstack sudo[85153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_xeh4_ynj Apr 10 13:17:59 devstack sudo[85153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:17:59 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root Apr 10 13:17:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35" returned: 0 in 1.418s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:17:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:17:59 devstack sudo[85160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35 Apr 10 13:17:59 devstack sudo[85160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:00 devstack sudo[85153]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_xeh4_ynj" returned: 0 in 1.219s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_xeh4_ynj {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:00 devstack sudo[85181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_xeh4_ynj Apr 10 13:18:00 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:00 devstack sudo[85160]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b770dcb2-3872-4932-82da-b2cea2637f35" returned: 0 in 0.813s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Lock "cinder-quobyte-b770dcb2-3872-4932-82da-b2cea2637f35" released by "delete_volume" :: held 2.406s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['a0fb6ff8-ce6f-4e2e-bc49-8394cd0644e0'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:00 devstack cinder-volume[82554]: WARNING cinder.quota [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-379662085 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-379662085, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Created reservations ['95488054-c97a-426b-bf90-c2f111400566', '57a8f9f6-5d80-4d49-ba3e-30d2218bd99e', '90552a3a-6e9b-4e3f-a545-5316598c9f55', '14786d0a-f3e6-4abe-85a6-85414a5a2f74'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:00 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598 1073741824" returned: 0 in 1.916s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:00 devstack sudo[85183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598 Apr 10 13:18:00 devstack sudo[85183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:01 devstack sudo[85186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:01 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:01 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_xeh4_ynj" returned: 1 in 0.987s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_xeh4_ynj' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bf8e61-3c0a-4449-a130-133083a4ea83]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:01 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD Apr 10 13:18:01 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:01 devstack sudo[85183]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598" returned: 0 in 1.111s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] <== create_volume: return (3108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.112s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d452d7c-603c-4544-a45d-2546b24ebcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24214b98-6e64-4ca8-b88f-cda77d902598', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b51aca-e3ee-41e3-a95e-d1afe20a7e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:01 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:01 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Volume volume-24214b98-6e64-4ca8-b88f-cda77d902598 (24214b98-6e64-4ca8-b88f-cda77d902598): created successfully Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b51aca-e3ee-41e3-a95e-d1afe20a7e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Flow 'volume_create_manager' (a4358edc-2901-4005-b269-93a38955d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.996s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:01 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-98ff6c00-ba39-4153-9902-2365092ca640 tempest-ServersNegativeTestJSON-1660561081 None] Created volume successfully. Apr 10 13:18:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-cd763989-9646-4827-9868-54e9301c248e tempest-GroupSnapshotsTest-1760158676 None] Delete group completed successfully. Apr 10 13:18:02 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD" returned: 0 in 1.236s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:02 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] 4ccac92a-bf64-4e00-af7f-9898d1d98b1d was qcow2, converting to raw {{(pid=82554) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 13:18:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:02 devstack sudo[85199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 Apr 10 13:18:02 devstack sudo[85199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Acquiring lock "cinder-24214b98-6e64-4ca8-b88f-cda77d902598-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Lock "cinder-24214b98-6e64-4ca8-b88f-cda77d902598-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Acquiring lock "cinder-quobyte-24214b98-6e64-4ca8-b88f-cda77d902598" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Lock "cinder-quobyte-24214b98-6e64-4ca8-b88f-cda77d902598" acquired by "delete_volume" :: waited 0.035s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:03 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[437fff0b-3dd0-4405-ba7e-6d86221e0c63]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:03 devstack sudo[85216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598 Apr 10 13:18:03 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:04 devstack sudo[85199]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56" returned: 0 in 2.190s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:04 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_11hu3j7fdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:18:04 devstack cinder-volume[82554]: INFO cinder.image.image_utils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Converted 112.00 MB image at 51.09 MB/s Apr 10 13:18:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:04 devstack sudo[85251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 1G Apr 10 13:18:04 devstack sudo[85251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:05 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598" returned: 0 in 1.619s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:05 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598 Apr 10 13:18:05 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:06 devstack sudo[85251]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 1G" returned: 0 in 1.376s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd070bf-8db7-4b41-989e-8e23467b2660]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:06 devstack sudo[85274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 Apr 10 13:18:06 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:06 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-24214b98-6e64-4ca8-b88f-cda77d902598" returned: 0 in 0.835s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Lock "cinder-quobyte-24214b98-6e64-4ca8-b88f-cda77d902598" released by "delete_volume" :: held 2.495s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:UPDATE=73,cinder:DELETE=3,cinder:SELECT=77,cinder:INSERT=18 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=86,cinder:INSERT=19,cinder:UPDATE=85,cinder:DELETE=3 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Created reservations ['e0f4540b-bb28-48a2-9d9f-51868ea97d4d', '1b41e119-2a50-48f7-b667-5f104755413f', '17286285-a543-4ae1-8655-9bc793b5be4b', '623c9ae5-dc53-472e-9891-26f2c400ad04'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:06 devstack sudo[85276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:06 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Acquiring lock "cinder-07eae33c-bcfb-40ae-b1fd-773d779afa4a-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Lock "cinder-07eae33c-bcfb-40ae-b1fd-773d779afa4a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Acquiring lock "cinder-quobyte-07eae33c-bcfb-40ae-b1fd-773d779afa4a" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Lock "cinder-quobyte-07eae33c-bcfb-40ae-b1fd-773d779afa4a" acquired by "delete_volume" :: waited 0.026s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b2911f-3a35-4d87-bf08-ce795a68ad54]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:07 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56" returned: 0 in 1.457s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:07 devstack sudo[85282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a Apr 10 13:18:07 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:07 devstack sudo[85283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 Apr 10 13:18:07 devstack sudo[85283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:07 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 1.461s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:07 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Deleted volume successfully. Apr 10 13:18:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f2d492c7-8398-48bd-94bb-7e71894af21a tempest-ServersNegativeTestJSON-1660561081 None] Lock "cinder-24214b98-6e64-4ca8-b88f-cda77d902598-delete_volume" released by "delete_volume" :: held 4.224s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:08 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a" returned: 0 in 1.267s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:08 devstack sudo[85292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a Apr 10 13:18:08 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:09 devstack sudo[85283]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56" returned: 1 in 1.629s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Downloaded image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d ((None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}])) to volume 834daac8-0b51-4fc0-bb89-70cc05b51c56 successfully. {{(pid=82554) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Temporary image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d for user 1763290559a640cd8e173e29fb5dacc1 is deleted. {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Marking volume 834daac8-0b51-4fc0-bb89-70cc05b51c56 as bootable. {{(pid=82554) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Copying metadata from image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d to 834daac8-0b51-4fc0-bb89-70cc05b51c56. {{(pid=82554) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Creating volume glance metadata for volume 834daac8-0b51-4fc0-bb89-70cc05b51c56 backed by image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82554) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26935319-9e9a-4003-8c55-1ada45b03403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834daac8-0b51-4fc0-bb89-70cc05b51c56', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c162c1c-bcf4-4cba-971d-274c2bce6048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:09 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Volume volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 (834daac8-0b51-4fc0-bb89-70cc05b51c56): created successfully Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c162c1c-bcf4-4cba-971d-274c2bce6048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Flow 'volume_create_manager' (f0579a2d-168a-4bb3-bdbb-4cb10e7bfbfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:09 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-55d8d467-8a45-4b62-9762-fea5067c4269 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Created volume successfully. Apr 10 13:18:09 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-07eae33c-bcfb-40ae-b1fd-773d779afa4a" returned: 0 in 0.923s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Lock "cinder-quobyte-07eae33c-bcfb-40ae-b1fd-773d779afa4a" released by "delete_volume" :: held 2.264s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Created reservations ['7765c317-8967-4d00-a887-be94e37eb69f', '62f6bee9-29fe-4d00-beea-51264c5b143a', '56b8de18-e6af-4735-8292-9bc540e154f7', '332cee3c-9078-4150-af85-11edc852ff39'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:09 devstack sudo[85296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:09 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:10 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.892s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:10 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:10 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Deleted volume successfully. Apr 10 13:18:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-22b85788-c907-48b2-8b0e-8d4befbca9de tempest-ServersNegativeTestJSON-1660561081 None] Lock "cinder-07eae33c-bcfb-40ae-b1fd-773d779afa4a-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-612a36dc-37dc-4f98-b124-ba72136f0a8d tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-612a36dc-37dc-4f98-b124-ba72136f0a8d tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:12 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf702af2-4b0d-46c2-8750-0b760c71db9f]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-612a36dc-37dc-4f98-b124-ba72136f0a8d tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:12 devstack sudo[85357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 Apr 10 13:18:12 devstack sudo[85357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:13 devstack sudo[85357]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-612a36dc-37dc-4f98-b124-ba72136f0a8d tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56" returned: 0 in 1.412s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-612a36dc-37dc-4f98-b124-ba72136f0a8d tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:13 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 Apr 10 13:18:13 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:14 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-612a36dc-37dc-4f98-b124-ba72136f0a8d tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56" returned: 1 in 0.783s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-612a36dc-37dc-4f98-b124-ba72136f0a8d tempest-ServerBootFromVolumeStableRescueTest-488282463 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:18:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-612a36dc-37dc-4f98-b124-ba72136f0a8d tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.331s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-612a36dc-37dc-4f98-b124-ba72136f0a8d tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539', 'name': 'volume-834daac8-0b51-4fc0-bb89-70cc05b51c56', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67f21383-3cea-44fb-a5f5-af0dbc698fc4', 'enforce_multipath': True} {{(pid=82554) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 13:18:14 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-81eb566e-954d-40af-a5cf-e755ad8e82fe req-612a36dc-37dc-4f98-b124-ba72136f0a8d tempest-ServerBootFromVolumeStableRescueTest-488282463 None] attachment_update completed successfully. Apr 10 13:18:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Acquiring lock "cinder-fd9dad68-2be1-4ac7-b084-756c9c7928ca-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Lock "cinder-fd9dad68-2be1-4ac7-b084-756c9c7928ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Acquiring lock "cinder-quobyte-fd9dad68-2be1-4ac7-b084-756c9c7928ca" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Lock "cinder-quobyte-fd9dad68-2be1-4ac7-b084-756c9c7928ca" acquired by "delete_volume" :: waited 0.015s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:14 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63d44a6-622b-4870-997e-26937d37ccb5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:14 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca Apr 10 13:18:14 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:15 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca" returned: 0 in 1.022s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:15 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca Apr 10 13:18:15 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:16 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fd9dad68-2be1-4ac7-b084-756c9c7928ca" returned: 0 in 1.146s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:16 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Lock "cinder-quobyte-fd9dad68-2be1-4ac7-b084-756c9c7928ca" released by "delete_volume" :: held 2.224s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:16 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Created reservations ['65cd8b36-bb18-4e17-896d-f20dcf8b3b24', '2598920f-8a63-4686-aa90-14edf73e50a6', '838ab66f-12a0-40e3-a4cd-279ebc3417c0', '0ff9bd3f-8cff-4658-85f8-fed613c83024'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:16 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:16 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:16 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:16 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:17 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-820a7d95-9147-4715-ab45-e034581b6790 tempest-GroupsV320Test-292929175 None] Group tempest-GroupsV320Test-Group-62723037: creating Apr 10 13:18:17 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-820a7d95-9147-4715-ab45-e034581b6790 tempest-GroupsV320Test-292929175 None] Group tempest-GroupsV320Test-Group-62723037: created successfully Apr 10 13:18:17 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-820a7d95-9147-4715-ab45-e034581b6790 tempest-GroupsV320Test-292929175 None] Create group completed successfully. Apr 10 13:18:17 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.555s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:17 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:17 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Deleted volume successfully. Apr 10 13:18:17 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f35605d-e1cf-49d9-92ea-409247fad003 tempest-ServerRescueNegativeTestJSON-1751887214 None] Lock "cinder-fd9dad68-2be1-4ac7-b084-756c9c7928ca-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:19 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-94e45ffa-71ad-4250-a82b-fc84d350c5ff tempest-GroupsV320Test-292929175 None] Created reservations ['3c125315-d858-406a-b2f3-1cc9043173be'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-94e45ffa-71ad-4250-a82b-fc84d350c5ff tempest-GroupsV320Test-292929175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-94e45ffa-71ad-4250-a82b-fc84d350c5ff tempest-GroupsV320Test-292929175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-94e45ffa-71ad-4250-a82b-fc84d350c5ff tempest-GroupsV320Test-292929175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-94e45ffa-71ad-4250-a82b-fc84d350c5ff tempest-GroupsV320Test-292929175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-94e45ffa-71ad-4250-a82b-fc84d350c5ff tempest-GroupsV320Test-292929175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-94e45ffa-71ad-4250-a82b-fc84d350c5ff tempest-GroupsV320Test-292929175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:19 devstack sudo[85445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:19 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:20 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-94e45ffa-71ad-4250-a82b-fc84d350c5ff tempest-GroupsV320Test-292929175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 1.681s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:20 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-94e45ffa-71ad-4250-a82b-fc84d350c5ff tempest-GroupsV320Test-292929175 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:20 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-94e45ffa-71ad-4250-a82b-fc84d350c5ff tempest-GroupsV320Test-292929175 None] Delete group completed successfully. Apr 10 13:18:22 devstack cinder-volume[82554]: DEBUG oslo_service.periodic_task [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82554) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:18:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:22 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:22 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:23 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.753s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:23 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Flow 'volume_create_manager' (90888b2e-3048-420f-a127-9f27bc91cce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c84c518-4e66-4b62-9d73-b2bf31c8f0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c84c518-4e66-4b62-9d73-b2bf31c8f0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-225303509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dd52bc-9571-426a-91f5-9218e8b61b93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc44ac49660449a28ca92808159fc456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:28Z,use_quota=True,user_id='b42892308d6e44178a810a9f92a9e866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23a49ed-cbec-488e-9b06-40627e7e8194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23a49ed-cbec-488e-9b06-40627e7e8194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97731826-5738-43a0-8cce-d83e1b9eafc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97731826-5738-43a0-8cce-d83e1b9eafc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3dd52bc-9571-426a-91f5-9218e8b61b93', 'volume_name': 'volume-d3dd52bc-9571-426a-91f5-9218e8b61b93', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8cd488-6abb-46ae-ad20-fe2cc59a465b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8cd488-6abb-46ae-ad20-fe2cc59a465b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55436b65-f670-4da5-b62a-ab79f6783e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:28 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Volume d3dd52bc-9571-426a-91f5-9218e8b61b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3dd52bc-9571-426a-91f5-9218e8b61b93', 'volume_size': 1} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-225303509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dd52bc-9571-426a-91f5-9218e8b61b93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cc44ac49660449a28ca92808159fc456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:28Z,use_quota=True,user_id='b42892308d6e44178a810a9f92a9e866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Creating volume d3dd52bc-9571-426a-91f5-9218e8b61b93 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:18:28 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:18:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:28 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93 1073741824 Apr 10 13:18:28 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:29 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93 1073741824" returned: 0 in 1.037s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:29 devstack sudo[85559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93 Apr 10 13:18:29 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:30 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93" returned: 0 in 0.632s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55436b65-f670-4da5-b62a-ab79f6783e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3dd52bc-9571-426a-91f5-9218e8b61b93', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025efdd2-62f0-4919-b578-1961e7b9f69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:30 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Volume volume-d3dd52bc-9571-426a-91f5-9218e8b61b93 (d3dd52bc-9571-426a-91f5-9218e8b61b93): created successfully Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025efdd2-62f0-4919-b578-1961e7b9f69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Flow 'volume_create_manager' (90888b2e-3048-420f-a127-9f27bc91cce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:30 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-809edcc2-7539-4d61-9559-99c41aefe7a1 req-34b57b1a-59c8-4e6c-bf74-2eb23401b189 tempest-VolumesGetTestJSON-1886502021 None] Created volume successfully. Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Acquiring lock "cinder-d3dd52bc-9571-426a-91f5-9218e8b61b93-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Lock "cinder-d3dd52bc-9571-426a-91f5-9218e8b61b93-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Acquiring lock "cinder-quobyte-d3dd52bc-9571-426a-91f5-9218e8b61b93" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Lock "cinder-quobyte-d3dd52bc-9571-426a-91f5-9218e8b61b93" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[224fbefe-f22f-4d11-ac71-ed1f42bd6fc3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:31 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93 Apr 10 13:18:31 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:31 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93" returned: 0 in 0.564s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:31 devstack sudo[85600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93 Apr 10 13:18:31 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:32 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3dd52bc-9571-426a-91f5-9218e8b61b93" returned: 0 in 0.511s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Lock "cinder-quobyte-d3dd52bc-9571-426a-91f5-9218e8b61b93" released by "delete_volume" :: held 1.104s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG cinder.quota [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Created reservations ['dbeb6a8b-c93a-48af-98af-576a97b7e3a9', '9c54b109-431d-4cd7-88f2-3621e4e72943', 'f7966c6e-04db-4dc6-814d-197f8516eea8', 'cb1199b4-5608-4ce0-999c-542648763272'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:32 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:32 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:32 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.494s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG cinder.manager [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:32 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Deleted volume successfully. Apr 10 13:18:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-09be6b7d-b3e3-42f0-a406-1d0035bf8c30 req-5dd0cc5d-2c90-48d8-bf30-f326932172f3 tempest-VolumesGetTestJSON-1886502021 None] Lock "cinder-d3dd52bc-9571-426a-91f5-9218e8b61b93-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-00a14584-0b05-4b55-8214-bfe0404b1f5c tempest-BackendsCapabilitiesAdminTestsJSON-460050003 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953620910645, 'free_capacity_gb': 1775.6953620910645, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82554) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 13:18:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9cbff877-eefe-482c-ba68-ab6223d141d9 tempest-BackendsCapabilitiesAdminTestsJSON-460050003 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953620910645, 'free_capacity_gb': 1775.6953620910645, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82554) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 13:18:39 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8cc07376-e0e5-41bd-bf73-105117c4ea0d tempest-GroupSnapshotsV319Test-1827997129 None] Group tempest-GroupSnapshotsV319Test-Group-677937028: creating Apr 10 13:18:39 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8cc07376-e0e5-41bd-bf73-105117c4ea0d tempest-GroupSnapshotsV319Test-1827997129 None] Group tempest-GroupSnapshotsV319Test-Group-677937028: created successfully Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Flow 'volume_create_manager' (8844a9bd-c5a1-4078-a124-c620439498c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2a9abf-78dc-40b3-a021-b8264805d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:39 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8cc07376-e0e5-41bd-bf73-105117c4ea0d tempest-GroupSnapshotsV319Test-1827997129 None] Create group completed successfully. Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2a9abf-78dc-40b3-a021-b8264805d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-507077193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5568d08d-8391-4ff4-8488-4371f49f29b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40562e1932064fddaef735d41e914d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:40Z,use_quota=True,user_id='34607d354efa48a499b5e56ee72e9ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2fe1ca4-dc2d-4d1b-bfe4-e7ce81c17e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2fe1ca4-dc2d-4d1b-bfe4-e7ce81c17e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af865da8-20e7-495e-a023-e0af85bb3442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af865da8-20e7-495e-a023-e0af85bb3442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5568d08d-8391-4ff4-8488-4371f49f29b0', 'volume_name': 'volume-5568d08d-8391-4ff4-8488-4371f49f29b0', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d544b1d1-6bda-4869-9d78-edb4aa939772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d544b1d1-6bda-4869-9d78-edb4aa939772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731ee300-c6b0-490e-9f05-61455b5819d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Volume 5568d08d-8391-4ff4-8488-4371f49f29b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5568d08d-8391-4ff4-8488-4371f49f29b0', 'volume_size': 1} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-507077193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5568d08d-8391-4ff4-8488-4371f49f29b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40562e1932064fddaef735d41e914d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:40Z,use_quota=True,user_id='34607d354efa48a499b5e56ee72e9ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Creating volume 5568d08d-8391-4ff4-8488-4371f49f29b0 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:18:39 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:18:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:39 devstack sudo[85698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0 1073741824 Apr 10 13:18:39 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:40 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0 1073741824" returned: 0 in 0.615s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:40 devstack sudo[85727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0 Apr 10 13:18:40 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:41 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0" returned: 0 in 0.618s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731ee300-c6b0-490e-9f05-61455b5819d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5568d08d-8391-4ff4-8488-4371f49f29b0', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16eec841-eace-4680-b288-db20e7ab56a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:41 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Volume volume-5568d08d-8391-4ff4-8488-4371f49f29b0 (5568d08d-8391-4ff4-8488-4371f49f29b0): created successfully Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16eec841-eace-4680-b288-db20e7ab56a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Flow 'volume_create_manager' (8844a9bd-c5a1-4078-a124-c620439498c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-412aca97-4211-41a6-b68e-8ba2f755a3b4 tempest-AbsoluteLimitsTests-2093028033 None] Created volume successfully. Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Flow 'volume_create_manager' (343729b7-5715-4e19-a2c5-8330162d88d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb4e5f4-878b-4acb-a5de-42abeba82a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb4e5f4-878b-4acb-a5de-42abeba82a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-712639051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6034ddfd-8129-4ebb-8ba4-ae6c3cea00dc,host='devstack@QuobyteHD#QuobyteHD',id=04c42c86-7889-4983-84b1-00a5c837fc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9fa80cb2134b1a8cc84aa35c931770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:41Z,use_quota=True,user_id='651850d730514233a0421c72b83872f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56793fc0-b1a4-45f5-8203-30305429c5a3),volume_type_id=56793fc0-b1a4-45f5-8203-30305429c5a3)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bc154b-88b6-40da-b540-658c08999ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bc154b-88b6-40da-b540-658c08999ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63ffe2a-a4d3-496d-90f7-0413d2e63ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63ffe2a-a4d3-496d-90f7-0413d2e63ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c42c86-7889-4983-84b1-00a5c837fc2e', 'volume_name': 'volume-04c42c86-7889-4983-84b1-00a5c837fc2e', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f09f4e-de64-4332-83c4-08088c6eb18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f09f4e-de64-4332-83c4-08088c6eb18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4fa2a2-f608-4ff6-a2e0-2ea36c5e4e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:41 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Volume 04c42c86-7889-4983-84b1-00a5c837fc2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c42c86-7889-4983-84b1-00a5c837fc2e', 'volume_size': 1} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6034ddfd-8129-4ebb-8ba4-ae6c3cea00dc,created_at=2026-04-10T11:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-712639051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6034ddfd-8129-4ebb-8ba4-ae6c3cea00dc,host='devstack@QuobyteHD#QuobyteHD',id=04c42c86-7889-4983-84b1-00a5c837fc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9fa80cb2134b1a8cc84aa35c931770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:41Z,use_quota=True,user_id='651850d730514233a0421c72b83872f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56793fc0-b1a4-45f5-8203-30305429c5a3),volume_type_id=56793fc0-b1a4-45f5-8203-30305429c5a3)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Creating volume 04c42c86-7889-4983-84b1-00a5c837fc2e {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:18:41 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:18:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:41 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e 1073741824 Apr 10 13:18:41 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Acquiring lock "cinder-5568d08d-8391-4ff4-8488-4371f49f29b0-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:42 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Lock "cinder-5568d08d-8391-4ff4-8488-4371f49f29b0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e 1073741824" returned: 0 in 0.851s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Acquiring lock "cinder-quobyte-5568d08d-8391-4ff4-8488-4371f49f29b0" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:42 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e Apr 10 13:18:42 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Lock "cinder-quobyte-5568d08d-8391-4ff4-8488-4371f49f29b0" acquired by "delete_volume" :: waited 0.029s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:42 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05917a0-2518-4caf-ae38-4a74b63f1167]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:42 devstack sudo[85748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0 Apr 10 13:18:42 devstack sudo[85748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:43 devstack sudo[85748]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0" returned: 0 in 0.654s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:43 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e" returned: 0 in 0.806s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:43 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0 Apr 10 13:18:43 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4fa2a2-f608-4ff6-a2e0-2ea36c5e4e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c42c86-7889-4983-84b1-00a5c837fc2e', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fb4cb4-305a-4cea-b982-a45b8368e679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:43 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Volume volume-04c42c86-7889-4983-84b1-00a5c837fc2e (04c42c86-7889-4983-84b1-00a5c837fc2e): created successfully Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fb4cb4-305a-4cea-b982-a45b8368e679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Flow 'volume_create_manager' (343729b7-5715-4e19-a2c5-8330162d88d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:43 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8bbd7f5c-7bc4-4800-be46-e4d5afbc459d tempest-GroupSnapshotsV319Test-1827997129 None] Created volume successfully. Apr 10 13:18:43 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] GroupSnapshot 59ddedc4-080a-4520-8270-7e5217cb9d27: creating. Apr 10 13:18:43 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5568d08d-8391-4ff4-8488-4371f49f29b0" returned: 0 in 0.567s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Group snapshot 59ddedc4-080a-4520-8270-7e5217cb9d27: creating. {{(pid=82554) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Lock "cinder-quobyte-5568d08d-8391-4ff4-8488-4371f49f29b0" released by "delete_volume" :: held 1.263s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Creating offline snapshot 28659cef-0287-44db-b33f-19e756517ae9 of volume 04c42c86-7889-4983-84b1-00a5c837fc2e {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[210dede7-d257-4d29-b2fb-cb6009afb6ad]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Created reservations ['86dd6203-269c-4491-b679-dd7e59a3d190', 'bc40d6ac-a3f0-434a-b701-28c314d551e0', '09e0033c-917d-4692-b316-b0cbfcf32c9b', '80b35c9f-42b2-4b7f-a291-54a2c57cae59'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:43 devstack sudo[85779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e Apr 10 13:18:43 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:43 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:43 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:44 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.459s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:44 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:44 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Deleted volume successfully. Apr 10 13:18:44 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e" returned: 0 in 0.563s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:44 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 1G Apr 10 13:18:44 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bff21211-e444-4605-b81b-15ed4e24770c tempest-AbsoluteLimitsTests-2093028033 None] Lock "cinder-5568d08d-8391-4ff4-8488-4371f49f29b0-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:44 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 1G" returned: 0 in 0.636s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c42c86-7889-4983-84b1-00a5c837fc2e -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:44 devstack sudo[85795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c42c86-7889-4983-84b1-00a5c837fc2e -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 Apr 10 13:18:44 devstack sudo[85795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:45 devstack sudo[85795]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c42c86-7889-4983-84b1-00a5c837fc2e -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9" returned: 0 in 0.556s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:45 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:18:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:45 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 Apr 10 13:18:45 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:45 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-f3c78056-98d3-490f-96bb-36abec28c721 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Terminate volume connection completed successfully. Apr 10 13:18:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-f3c78056-98d3-490f-96bb-36abec28c721 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Deleting attachment 67f21383-3cea-44fb-a5f5-af0dbc698fc4. {{(pid=82554) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 13:18:46 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9" returned: 0 in 0.595s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:46 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.info Apr 10 13:18:46 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "cinder-834daac8-0b51-4fc0-bb89-70cc05b51c56-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "cinder-834daac8-0b51-4fc0-bb89-70cc05b51c56-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "cinder-quobyte-834daac8-0b51-4fc0-bb89-70cc05b51c56" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "cinder-quobyte-834daac8-0b51-4fc0-bb89-70cc05b51c56" acquired by "delete_volume" :: waited 0.022s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed438e0-070c-4d36-a7e4-23cba31f8330]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:46 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 Apr 10 13:18:46 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:46 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-97124426-97d1-4a93-8837-fbade98ff288 tempest-GroupsTest-1061138109 None] Group tempest-Group1-1309622462: creating Apr 10 13:18:46 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-97124426-97d1-4a93-8837-fbade98ff288 tempest-GroupsTest-1061138109 None] Group tempest-Group1-1309622462: created successfully Apr 10 13:18:46 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-97124426-97d1-4a93-8837-fbade98ff288 tempest-GroupsTest-1061138109 None] Create group completed successfully. Apr 10 13:18:46 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.info" returned: 0 in 0.605s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:46 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:46 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.info Apr 10 13:18:46 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:46 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56" returned: 0 in 0.595s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:47 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 Apr 10 13:18:47 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:47 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.info" returned: 0 in 0.549s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.588s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:47 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3e8163a7-8827-4fb6-b339-1a83b753e0b7 tempest-GroupSnapshotsV319Test-1827997129 None] group_snapshot 59ddedc4-080a-4520-8270-7e5217cb9d27: created successfully Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Flow 'volume_create_manager' (69d53ac0-66ab-4574-9c4b-89d040f573fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951f27dd-b9e1-4e93-9a97-a6efcdd385f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951f27dd-b9e1-4e93-9a97-a6efcdd385f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-312128781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ab90c4-4874-4b27-aad7-3e42d1c00821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df75aba77f443e7bfcda22804e8f98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:47Z,use_quota=True,user_id='68e20337e07c4927a972dae384829e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3d10ba-23e5-449e-aff9-708a5d42c201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3d10ba-23e5-449e-aff9-708a5d42c201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2205fa59-5904-4c35-b09f-615f5b9c2efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2205fa59-5904-4c35-b09f-615f5b9c2efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ab90c4-4874-4b27-aad7-3e42d1c00821', 'volume_name': 'volume-72ab90c4-4874-4b27-aad7-3e42d1c00821', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:47 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556aefd5-bb3e-412c-8fd0-ebd1eb59d13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (556aefd5-bb3e-412c-8fd0-ebd1eb59d13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef2fb24-1c9a-4b62-a93a-b5d3b7b50c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:47 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Volume 72ab90c4-4874-4b27-aad7-3e42d1c00821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ab90c4-4874-4b27-aad7-3e42d1c00821', 'volume_size': 1} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-312128781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ab90c4-4874-4b27-aad7-3e42d1c00821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df75aba77f443e7bfcda22804e8f98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:47Z,use_quota=True,user_id='68e20337e07c4927a972dae384829e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Creating volume 72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:18:47 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56" returned: 1 in 0.581s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:18:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:47 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 1073741824 Apr 10 13:18:47 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:47 devstack sudo[85820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56 Apr 10 13:18:47 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:47 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-375d97ec-b423-4e25-821b-552b0a85eb00 tempest-GroupsTest-1061138109 None] Group tempest-Group2-835822083: creating Apr 10 13:18:47 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-375d97ec-b423-4e25-821b-552b0a85eb00 tempest-GroupsTest-1061138109 None] Group tempest-Group2-835822083: created successfully Apr 10 13:18:47 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-375d97ec-b423-4e25-821b-552b0a85eb00 tempest-GroupsTest-1061138109 None] Create group completed successfully. Apr 10 13:18:48 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-834daac8-0b51-4fc0-bb89-70cc05b51c56" returned: 0 in 0.545s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "cinder-quobyte-834daac8-0b51-4fc0-bb89-70cc05b51c56" released by "delete_volume" :: held 1.779s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:48 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 1073741824" returned: 0 in 0.594s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.quota [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Created reservations ['629e9f3b-4e96-4844-a728-0e33ef5f80b8', 'd11e503d-0682-4930-81ab-0e57040ecd74', '22713859-a1e7-4be3-a509-652b1a292277', 'cc9ed1ea-25a6-4608-856b-6a71d18aa1c1'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:48 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] group_snapshot 59ddedc4-080a-4520-8270-7e5217cb9d27: deleting Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] group_snapshot 59ddedc4-080a-4520-8270-7e5217cb9d27: deleting {{(pid=82554) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 13:18:48 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 Apr 10 13:18:48 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Acquiring lock "cinder-quobyte-04c42c86-7889-4983-84b1-00a5c837fc2e" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Lock "cinder-quobyte-04c42c86-7889-4983-84b1-00a5c837fc2e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Acquiring lock "cinder-quobyte-28659cef-0287-44db-b33f-19e756517ae9" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:48 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Lock "cinder-quobyte-28659cef-0287-44db-b33f-19e756517ae9" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:48 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Deleting offline snapshot 28659cef-0287-44db-b33f-19e756517ae9 of volume 04c42c86-7889-4983-84b1-00a5c837fc2e {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] snapshot_file for this snap is: volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2d9424-d9f8-4bc1-ac80-36f156f22323]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:48 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 Apr 10 13:18:48 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:48 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821" returned: 0 in 0.424s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef2fb24-1c9a-4b62-a93a-b5d3b7b50c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ab90c4-4874-4b27-aad7-3e42d1c00821', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4860dac-d9f5-4d3b-bbdd-4ad940f4736e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:48 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Volume volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 (72ab90c4-4874-4b27-aad7-3e42d1c00821): created successfully Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4860dac-d9f5-4d3b-bbdd-4ad940f4736e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Flow 'volume_create_manager' (69d53ac0-66ab-4574-9c4b-89d040f573fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:48 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9d90b4f5-691c-4bf8-bf1d-0f5c250276d4 tempest-VolumesDeleteCascade-1722811480 None] Created volume successfully. Apr 10 13:18:48 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.470s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.manager [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:48 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Deleted volume successfully. Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-a6be5faa-70f5-4d19-95a5-4fd3654feb9f req-87472624-6fd8-4cff-bab3-cabc383c9b51 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "cinder-834daac8-0b51-4fc0-bb89-70cc05b51c56-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:48 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9" returned: 0 in 0.515s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04c42c86-7889-4983-84b1-00a5c837fc2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0140309-15e1-4823-9133-5c07f77436aa]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:48 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e Apr 10 13:18:48 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Flow 'volume_create_manager' (b0fc8455-6f0f-41c7-9bea-a14d6842f1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96c3945-f1ec-4b9a-af94-46b9dd3119d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96c3945-f1ec-4b9a-af94-46b9dd3119d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-440597674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6cc2d7db-9496-4294-b281-f4cf928bddd2,host='devstack@QuobyteHD#QuobyteHD',id=6c40eed7-0a50-492b-9c83-086c4ba900dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8feb34acb174e62b5157db00b3cf4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:49Z,use_quota=True,user_id='b02c3cd76bb8490aad1873494798dd19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c572be7-3782-40e1-973a-e1e48a7e49d3),volume_type_id=6c572be7-3782-40e1-973a-e1e48a7e49d3)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b28323-1826-452d-af26-ae6bda310068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b28323-1826-452d-af26-ae6bda310068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b577d7a2-2b76-461e-8e28-adf8dfee8025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b577d7a2-2b76-461e-8e28-adf8dfee8025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c40eed7-0a50-492b-9c83-086c4ba900dc', 'volume_name': 'volume-6c40eed7-0a50-492b-9c83-086c4ba900dc', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7588a8-b68a-4d77-b7e5-b1b299589e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7588a8-b68a-4d77-b7e5-b1b299589e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322fa544-b24a-471d-951f-9083c3ea38f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:49 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Volume 6c40eed7-0a50-492b-9c83-086c4ba900dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c40eed7-0a50-492b-9c83-086c4ba900dc', 'volume_size': 1} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6cc2d7db-9496-4294-b281-f4cf928bddd2,created_at=2026-04-10T11:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-440597674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6cc2d7db-9496-4294-b281-f4cf928bddd2,host='devstack@QuobyteHD#QuobyteHD',id=6c40eed7-0a50-492b-9c83-086c4ba900dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8feb34acb174e62b5157db00b3cf4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:49Z,use_quota=True,user_id='b02c3cd76bb8490aad1873494798dd19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c572be7-3782-40e1-973a-e1e48a7e49d3),volume_type_id=6c572be7-3782-40e1-973a-e1e48a7e49d3)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Creating volume 6c40eed7-0a50-492b-9c83-086c4ba900dc {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:18:49 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:49 devstack sudo[85840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc 1073741824 Apr 10 13:18:49 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:49 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e" returned: 0 in 0.525s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:49 devstack sudo[85845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 Apr 10 13:18:49 devstack sudo[85845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:49 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc 1073741824" returned: 0 in 0.570s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:49 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc Apr 10 13:18:49 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:49 devstack sudo[85845]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9" returned: 0 in 0.573s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:49 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9 Apr 10 13:18:49 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:50 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc" returned: 0 in 0.437s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.449s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Creating offline snapshot 8aa878f0-4de5-4e77-86c3-089d934cff77 of volume 72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322fa544-b24a-471d-951f-9083c3ea38f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c40eed7-0a50-492b-9c83-086c4ba900dc', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e8f304-01fe-4d68-9f1c-6cc7403baa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a11ced-a6e7-4354-a2b9-8be3418018e3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:50 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Volume volume-6c40eed7-0a50-492b-9c83-086c4ba900dc (6c40eed7-0a50-492b-9c83-086c4ba900dc): created successfully Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e8f304-01fe-4d68-9f1c-6cc7403baa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Flow 'volume_create_manager' (b0fc8455-6f0f-41c7-9bea-a14d6842f1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:50 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-97f49ce6-2e72-44e3-aa12-106199af8d76 tempest-GroupsTest-1061138109 None] Created volume successfully. Apr 10 13:18:50 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 Apr 10 13:18:50 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:50 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e.28659cef-0287-44db-b33f-19e756517ae9" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Lock "cinder-quobyte-28659cef-0287-44db-b33f-19e756517ae9" released by "_delete_snapshot" :: held 2.078s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Lock "cinder-quobyte-04c42c86-7889-4983-84b1-00a5c837fc2e" released by "delete_snapshot" :: held 2.089s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:50 devstack cinder-volume[82554]: WARNING cinder.quota [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-988407881 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-988407881, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:18:50 devstack cinder-volume[82554]: WARNING cinder.quota [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-988407881 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-988407881, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] Created reservations ['22983b24-184b-4546-9ebd-6a38454c63f0', 'bbe889b2-2756-4ba8-be70-8d1ee0371c7a', 'f2f26e43-3f75-4c8d-b9ce-75f59f2f083e', '4e63ebed-d40f-4993-85aa-6485c9c8d400'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:50 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4abf14a0-3562-4189-92cd-fe1d1539e31f tempest-GroupSnapshotsV319Test-1827997129 None] group_snapshot 59ddedc4-080a-4520-8270-7e5217cb9d27: deleted successfully Apr 10 13:18:50 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821" returned: 0 in 0.578s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:50 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 1G Apr 10 13:18:50 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:51 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 1G" returned: 0 in 0.551s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:51 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 Apr 10 13:18:51 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Acquiring lock "cinder-quobyte-6c40eed7-0a50-492b-9c83-086c4ba900dc" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Acquiring lock "cinder-quobyte-04c42c86-7889-4983-84b1-00a5c837fc2e" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Lock "cinder-quobyte-6c40eed7-0a50-492b-9c83-086c4ba900dc" acquired by "delete_volume" :: waited 0.016s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Lock "cinder-quobyte-04c42c86-7889-4983-84b1-00a5c837fc2e" acquired by "delete_volume" :: waited 0.016s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6452022-258b-4e95-9f8d-fd6c7886a915]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8df91cb-0911-4485-899e-852fb195c894]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:51 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc Apr 10 13:18:51 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:51 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e Apr 10 13:18:51 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:51 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77" returned: 0 in 0.485s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:51 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 is being set with open permissions: ugo+rw Apr 10 13:18:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:51 devstack sudo[85908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 Apr 10 13:18:51 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:52 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc" returned: 0 in 0.607s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:52 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc Apr 10 13:18:52 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:52 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e" returned: 0 in 0.635s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:52 devstack sudo[85920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e Apr 10 13:18:52 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:52 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77" returned: 0 in 0.518s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:52 devstack sudo[85923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.info Apr 10 13:18:52 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:52 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6c40eed7-0a50-492b-9c83-086c4ba900dc" returned: 0 in 0.452s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Lock "cinder-quobyte-6c40eed7-0a50-492b-9c83-086c4ba900dc" released by "delete_volume" :: held 1.100s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:52 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-04c42c86-7889-4983-84b1-00a5c837fc2e" returned: 0 in 0.470s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Lock "cinder-quobyte-04c42c86-7889-4983-84b1-00a5c837fc2e" released by "delete_volume" :: held 1.161s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Created reservations ['90878f18-41e3-4db3-8ed7-6fae9168faca'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:52 devstack cinder-volume[82554]: WARNING cinder.quota [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-439761444 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-439761444, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:18:52 devstack cinder-volume[82554]: WARNING cinder.quota [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-439761444 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-439761444, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Created reservations ['3c936b70-580c-4c0a-8177-8ed1ac1453ea'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Created reservations ['e6719372-c601-41a5-88e2-681e846b3c15', 'b0b0efd8-ba82-4fe7-8d8b-174f1d49485e', '05fe492c-a19e-4365-9237-53800e608d25', '2f03edf2-4075-4931-bbea-e60acc8fb48d'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:52 devstack cinder-volume[82554]: WARNING cinder.quota [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-988407881 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-988407881, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Created reservations ['f1599b7d-f0a7-41e8-9b5f-282eefe0408b', '0410e3a9-ee94-448a-80c3-b6405c632eba', '59ef8d6a-d365-44a5-a059-02501898ff10', 'cc044c12-8188-42eb-8e4c-f6a2c8f64037'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:52 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.info" returned: 0 in 0.458s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:52 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.info is being set with open permissions: ugo+rw Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:52 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.info Apr 10 13:18:52 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:52 devstack sudo[85931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:52 devstack sudo[85931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:52 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:52 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:53 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.info" returned: 0 in 0.454s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.107s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:53 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c24ddaac-a7da-455c-8b37-788fbcecf7bf tempest-VolumesDeleteCascade-1722811480 None] Create snapshot completed successfully Apr 10 13:18:53 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.422s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:53 devstack sudo[85931]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.452s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:53 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3385b8f1-83a6-49cc-ac9c-4c7cab93c3a1 tempest-GroupsTest-1061138109 None] Delete group completed successfully. Apr 10 13:18:53 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7999db5e-6f71-4986-9d5d-86c8d7af9169 tempest-GroupSnapshotsV319Test-1827997129 None] Delete group completed successfully. Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-5fad0665-32f9-41d6-be91-e1d269c5e866 tempest-GroupsTest-1061138109 None] Created reservations ['4a50d9c1-6eac-4a07-b308-bb889aaff29b'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5fad0665-32f9-41d6-be91-e1d269c5e866 tempest-GroupsTest-1061138109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5fad0665-32f9-41d6-be91-e1d269c5e866 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5fad0665-32f9-41d6-be91-e1d269c5e866 tempest-GroupsTest-1061138109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5fad0665-32f9-41d6-be91-e1d269c5e866 tempest-GroupsTest-1061138109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5fad0665-32f9-41d6-be91-e1d269c5e866 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5fad0665-32f9-41d6-be91-e1d269c5e866 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:53 devstack sudo[85938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:18:53 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] Creating offline snapshot ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 of volume 72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:18:54 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[679d61ff-a2b1-45f0-a3b1-0a21fa3ae787]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:54 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 Apr 10 13:18:54 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:54 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5fad0665-32f9-41d6-be91-e1d269c5e866 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.531s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:54 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-5fad0665-32f9-41d6-be91-e1d269c5e866 tempest-GroupsTest-1061138109 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:18:54 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-5fad0665-32f9-41d6-be91-e1d269c5e866 tempest-GroupsTest-1061138109 None] Delete group completed successfully. Apr 10 13:18:54 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77" returned: 0 in 0.587s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ab90c4-4874-4b27-aad7-3e42d1c00821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:18:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:54 devstack sudo[85946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 1G Apr 10 13:18:54 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:55 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 1G" returned: 0 in 0.608s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:55 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 Apr 10 13:18:55 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-cf750d6a-220c-4e5d-8242-8707d1078087 tempest-GroupsTest-1061138109 None] Group tempest-GroupsTest-Group-1973215005: creating Apr 10 13:18:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-cf750d6a-220c-4e5d-8242-8707d1078087 tempest-GroupsTest-1061138109 None] Group tempest-GroupsTest-Group-1973215005: created successfully Apr 10 13:18:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-cf750d6a-220c-4e5d-8242-8707d1078087 tempest-GroupsTest-1061138109 None] Create group completed successfully. Apr 10 13:18:55 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7" returned: 0 in 0.547s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:55 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 is being set with open permissions: ugo+rw Apr 10 13:18:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:55 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 Apr 10 13:18:55 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:56 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7" returned: 0 in 0.438s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:56 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c08b0a2a-4029-4794-be9d-ccd89edd2e80 tempest-VolumesDeleteCascade-1722811480 None] Create snapshot completed successfully Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Flow 'volume_create_manager' (bc24b893-b454-47c4-bc41-8617a30b2402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39046f3-bb45-49a8-abff-efa9b1ea6ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39046f3-bb45-49a8-abff-efa9b1ea6ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-607261978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a1aa6f2-0cbe-492a-9d3e-c06e3cb0ba98,host='devstack@QuobyteHD#QuobyteHD',id=a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8feb34acb174e62b5157db00b3cf4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:57Z,use_quota=True,user_id='b02c3cd76bb8490aad1873494798dd19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3a14ba7-0123-401b-83f8-fe0a1ff98e5c),volume_type_id=e3a14ba7-0123-401b-83f8-fe0a1ff98e5c)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a9ec7b-15f4-4f7b-9f4b-822b6982e671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a9ec7b-15f4-4f7b-9f4b-822b6982e671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c26d41-ac7f-431b-a321-c3efaea8c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c26d41-ac7f-431b-a321-c3efaea8c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b', 'volume_name': 'volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cb7cfd-827b-4da4-bc5f-2f274b758e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cb7cfd-827b-4da4-bc5f-2f274b758e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3922948-2752-4751-a0e5-cd748a7f395e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:56 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Volume a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b', 'volume_size': 1} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4a1aa6f2-0cbe-492a-9d3e-c06e3cb0ba98,created_at=2026-04-10T11:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-607261978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a1aa6f2-0cbe-492a-9d3e-c06e3cb0ba98,host='devstack@QuobyteHD#QuobyteHD',id=a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8feb34acb174e62b5157db00b3cf4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:57Z,use_quota=True,user_id='b02c3cd76bb8490aad1873494798dd19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3a14ba7-0123-401b-83f8-fe0a1ff98e5c),volume_type_id=e3a14ba7-0123-401b-83f8-fe0a1ff98e5c)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Creating volume a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:18:56 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:18:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:56 devstack sudo[85975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b 1073741824 Apr 10 13:18:56 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:57 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-354eecc7-6003-410a-9a90-47efdfab34ba tempest-GroupsV314Test-424220256 None] Group tempest-GroupsV314Test-Group-823075429: creating Apr 10 13:18:57 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-354eecc7-6003-410a-9a90-47efdfab34ba tempest-GroupsV314Test-424220256 None] Group tempest-GroupsV314Test-Group-823075429: created successfully Apr 10 13:18:57 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-354eecc7-6003-410a-9a90-47efdfab34ba tempest-GroupsV314Test-424220256 None] Create group completed successfully. Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-72ab90c4-4874-4b27-aad7-3e42d1c00821-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-72ab90c4-4874-4b27-aad7-3e42d1c00821-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Performing cascade delete. {{(pid=82554) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-8aa878f0-4de5-4e77-86c3-089d934cff77-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-8aa878f0-4de5-4e77-86c3-089d934cff77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-72ab90c4-4874-4b27-aad7-3e42d1c00821" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-72ab90c4-4874-4b27-aad7-3e42d1c00821" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-8aa878f0-4de5-4e77-86c3-089d934cff77" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-8aa878f0-4de5-4e77-86c3-089d934cff77" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Deleting offline snapshot 8aa878f0-4de5-4e77-86c3-089d934cff77 of volume 72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] snapshot_file for this snap is: volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb17d52-99d3-41e8-a2e2-e8582d069892]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:57 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 Apr 10 13:18:57 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:57 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b 1073741824" returned: 0 in 0.654s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:57 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b Apr 10 13:18:57 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:57 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77" returned: 0 in 0.549s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ab90c4-4874-4b27-aad7-3e42d1c00821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4949fc-257e-4014-ab11-bdc8d3cd8d76]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:57 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b" returned: 0 in 0.425s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3922948-2752-4751-a0e5-cd748a7f395e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4deca7-d102-41bf-bded-24d8d6a16551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:57 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Volume volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b (a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b): created successfully Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4deca7-d102-41bf-bded-24d8d6a16551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Flow 'volume_create_manager' (bc24b893-b454-47c4-bc41-8617a30b2402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:57 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-95ec1303-b002-4c32-ab7d-b967f0e2fa29 tempest-GroupsTest-1061138109 None] Created volume successfully. Apr 10 13:18:57 devstack sudo[86003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 Apr 10 13:18:57 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:58 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821" returned: 0 in 0.546s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d4d603-9f41-4c6e-89e6-5fb35f87075b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:18:58 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 Apr 10 13:18:58 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Flow 'volume_create_manager' (0a619bb1-4f0b-4969-aa0b-8eb874f0adf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036bda45-eeb6-4eb0-8090-99ab3e44e1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036bda45-eeb6-4eb0-8090-99ab3e44e1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469738733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66d7577c-265a-4b70-a7dc-77e85ac32b98,host='devstack@QuobyteHD#QuobyteHD',id=90a76731-55f8-4dbb-894f-757d4e8ddb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1ff55d303242c09847c670d5a84313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:58Z,use_quota=True,user_id='5621ee3605dc46468e91611fe29d3243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12606ce-f00b-41c4-baed-121dfb93e646),volume_type_id=b12606ce-f00b-41c4-baed-121dfb93e646)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7219e119-b893-4a86-9805-a9cf48192820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7219e119-b893-4a86-9805-a9cf48192820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6374578-557a-4878-a0dc-505eb2a43d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6374578-557a-4878-a0dc-505eb2a43d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a76731-55f8-4dbb-894f-757d4e8ddb28', 'volume_name': 'volume-90a76731-55f8-4dbb-894f-757d4e8ddb28', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8159fbaf-c689-4235-9747-13ecfaba1ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8159fbaf-c689-4235-9747-13ecfaba1ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff46f4b-ade6-45b5-80ea-2643f0ca2e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:58 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Volume 90a76731-55f8-4dbb-894f-757d4e8ddb28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a76731-55f8-4dbb-894f-757d4e8ddb28', 'volume_size': 1} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66d7577c-265a-4b70-a7dc-77e85ac32b98,created_at=2026-04-10T11:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469738733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66d7577c-265a-4b70-a7dc-77e85ac32b98,host='devstack@QuobyteHD#QuobyteHD',id=90a76731-55f8-4dbb-894f-757d4e8ddb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1ff55d303242c09847c670d5a84313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:58Z,use_quota=True,user_id='5621ee3605dc46468e91611fe29d3243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b12606ce-f00b-41c4-baed-121dfb93e646),volume_type_id=b12606ce-f00b-41c4-baed-121dfb93e646)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Creating volume 90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:18:58 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:58 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 1073741824 Apr 10 13:18:58 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:58 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7" returned: 0 in 0.554s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ab90c4-4874-4b27-aad7-3e42d1c00821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b4f778-b3e2-4366-8237-237b14a54c78]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:59 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 Apr 10 13:18:59 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:59 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 1073741824" returned: 0 in 0.539s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:18:59 devstack sudo[86023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 Apr 10 13:18:59 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Flow 'volume_create_manager' (e6577a4f-8710-4485-b9ec-5efe4612ca27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05c563e-d981-45b6-beac-8c99b8cc9891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05c563e-d981-45b6-beac-8c99b8cc9891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1951191771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a1aa6f2-0cbe-492a-9d3e-c06e3cb0ba98,host='devstack@QuobyteHD#QuobyteHD',id=fa09f753-f682-4f78-88e8-0e0868540ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8feb34acb174e62b5157db00b3cf4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:59Z,use_quota=True,user_id='b02c3cd76bb8490aad1873494798dd19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3a14ba7-0123-401b-83f8-fe0a1ff98e5c),volume_type_id=e3a14ba7-0123-401b-83f8-fe0a1ff98e5c)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0228741-8283-4736-990c-b3a10f0a821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0228741-8283-4736-990c-b3a10f0a821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834d701f-76e1-437b-ac09-5a1dd789e953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834d701f-76e1-437b-ac09-5a1dd789e953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa09f753-f682-4f78-88e8-0e0868540ca1', 'volume_name': 'volume-fa09f753-f682-4f78-88e8-0e0868540ca1', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67755f80-c89c-4463-95e6-a0458285314d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67755f80-c89c-4463-95e6-a0458285314d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dcded5c-7405-4f7c-ade0-09eef8570312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:59 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Volume fa09f753-f682-4f78-88e8-0e0868540ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa09f753-f682-4f78-88e8-0e0868540ca1', 'volume_size': 1} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:59 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-b0bda574-119b-44e6-9439-d60c8130471c req-fbb80872-7b86-47da-9048-fcffa24d1dbe tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Terminate volume connection completed successfully. Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [req-b0bda574-119b-44e6-9439-d60c8130471c req-fbb80872-7b86-47da-9048-fcffa24d1dbe tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Deleting attachment 3886f908-47d5-412b-81cc-99ca5783fc23. {{(pid=82554) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 13:18:59 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77" returned: 0 in 0.542s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ab90c4-4874-4b27-aad7-3e42d1c00821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3b1f64-7826-429a-b327-d0a8a115e69d]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:59 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28" returned: 0 in 0.439s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.374s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4a1aa6f2-0cbe-492a-9d3e-c06e3cb0ba98,created_at=2026-04-10T11:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1951191771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a1aa6f2-0cbe-492a-9d3e-c06e3cb0ba98,host='devstack@QuobyteHD#QuobyteHD',id=fa09f753-f682-4f78-88e8-0e0868540ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8feb34acb174e62b5157db00b3cf4fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:18:59Z,use_quota=True,user_id='b02c3cd76bb8490aad1873494798dd19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3a14ba7-0123-401b-83f8-fe0a1ff98e5c),volume_type_id=e3a14ba7-0123-401b-83f8-fe0a1ff98e5c)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Creating volume fa09f753-f682-4f78-88e8-0e0868540ca1 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:18:59 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff46f4b-ade6-45b5-80ea-2643f0ca2e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a76731-55f8-4dbb-894f-757d4e8ddb28', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:59 devstack sudo[86029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 Apr 10 13:18:59 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c33c8e-bf74-4e21-a43a-cd2b9f3624a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:18:59 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1 1073741824 Apr 10 13:18:59 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:18:59 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Volume volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 (90a76731-55f8-4dbb-894f-757d4e8ddb28): created successfully Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c33c8e-bf74-4e21-a43a-cd2b9f3624a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Flow 'volume_create_manager' (0a619bb1-4f0b-4969-aa0b-8eb874f0adf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:18:59 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-042d2496-030d-45c3-a091-db0e64ab5666 tempest-GroupsV314Test-424220256 None] Created volume successfully. Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "cinder-dce800ac-2731-40a5-be64-d5b4085922c3-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "cinder-dce800ac-2731-40a5-be64-d5b4085922c3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "cinder-quobyte-dce800ac-2731-40a5-be64-d5b4085922c3" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "cinder-quobyte-dce800ac-2731-40a5-be64-d5b4085922c3" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f840a9e-9f0b-45c6-a03a-faf6fa946ddc]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:18:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:00 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 Apr 10 13:19:00 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:00 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821" returned: 0 in 0.556s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:00 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 Apr 10 13:19:00 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:00 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1 1073741824" returned: 0 in 0.520s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:00 devstack sudo[86043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1 Apr 10 13:19:00 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:00 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3" returned: 0 in 0.558s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:00 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3 Apr 10 13:19:00 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:00 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1" returned: 0 in 0.466s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:00 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77" returned: 0 in 0.538s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dcded5c-7405-4f7c-ade0-09eef8570312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa09f753-f682-4f78-88e8-0e0868540ca1', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605a18ce-66bb-4cdf-be89-57209b9af34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:00 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77 Apr 10 13:19:00 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:00 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Volume volume-fa09f753-f682-4f78-88e8-0e0868540ca1 (fa09f753-f682-4f78-88e8-0e0868540ca1): created successfully Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605a18ce-66bb-4cdf-be89-57209b9af34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Flow 'volume_create_manager' (e6577a4f-8710-4485-b9ec-5efe4612ca27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:00 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-da6b7e40-096e-4bca-9df8-f87d446aa3f4 tempest-GroupsTest-1061138109 None] Created volume successfully. Apr 10 13:19:00 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dce800ac-2731-40a5-be64-d5b4085922c3" returned: 0 in 0.454s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "cinder-quobyte-dce800ac-2731-40a5-be64-d5b4085922c3" released by "delete_volume" :: held 1.035s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.quota [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Created reservations ['e2fa79d4-0cab-4b6f-a129-4b7e2f8eed1a', '7f51ea99-3449-4b15-85c0-c442e000ccec', 'e2467f0e-eb8a-440b-bcb3-d8c4526cb41e', '3bc03069-92b8-495c-b285-329c1774932f'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:01 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.8aa878f0-4de5-4e77-86c3-089d934cff77" returned: 0 in 0.449s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 -F qcow2 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:01 devstack sudo[86059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:01 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:01 devstack sudo[86060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 -F qcow2 Apr 10 13:19:01 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-e8c221e4-996e-4971-8bfe-9e6a3f91b7fc tempest-GroupsTest-1061138109 None] Update group completed successfully. Apr 10 13:19:01 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:01 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.499s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.manager [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 -F qcow2" returned: 0 in 0.493s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Deleted volume successfully. Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-8aa878f0-4de5-4e77-86c3-089d934cff77" released by "_delete_snapshot" :: held 4.335s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-72ab90c4-4874-4b27-aad7-3e42d1c00821" released by "delete_snapshot" :: held 4.353s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [req-b0bda574-119b-44e6-9439-d60c8130471c req-bd8f98f6-4bc4-4a2b-9ba4-d85358d9f126 tempest-ServerBootFromVolumeStableRescueTest-488282463 None] Lock "cinder-dce800ac-2731-40a5-be64-d5b4085922c3-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:01 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Cloning volume 90a76731-55f8-4dbb-894f-757d4e8ddb28 to volume 32492b00-fd20-44e5-8f62-b082569028ea Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Creating offline snapshot 2a731ea1-5312-4b37-b758-fa62b478d165 of volume 90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5796149f-df71-462c-a479-815f0dd87400]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Created reservations ['874a7359-95a8-4f3d-8ee0-0cc53076e9ab', '54fd0074-ae75-4169-b612-cbea5c78c34b', 'fb60f001-72c1-462b-ae9f-f8e0d0ae22f5', '44645422-6863-45ed-96ae-92878f15329c'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Delete snapshot completed successfully. Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-8aa878f0-4de5-4e77-86c3-089d934cff77-delete_snapshot" released by "delete_snapshot" :: held 4.533s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-ea67fcbf-b6ef-4246-8fa0-46e69897e7d7-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:01 devstack sudo[86067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 Apr 10 13:19:01 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-ea67fcbf-b6ef-4246-8fa0-46e69897e7d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-72ab90c4-4874-4b27-aad7-3e42d1c00821" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-72ab90c4-4874-4b27-aad7-3e42d1c00821" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-ea67fcbf-b6ef-4246-8fa0-46e69897e7d7" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-ea67fcbf-b6ef-4246-8fa0-46e69897e7d7" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Deleting offline snapshot ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 of volume 72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] snapshot_file for this snap is: volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbc331e-1c19-41fc-822d-82c59eda4fd2]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:01 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 Apr 10 13:19:01 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:02 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28" returned: 0 in 0.492s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:02 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 1G Apr 10 13:19:02 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:02 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7" returned: 0 in 0.479s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ab90c4-4874-4b27-aad7-3e42d1c00821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:02 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a1948f-802d-4b0b-9346-704748039877]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:02 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 Apr 10 13:19:02 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:02 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-09cb0ba7-e8f0-4df6-8c0b-24f6f74fd6d2 tempest-GroupsTest-1061138109 None] Update group completed successfully. Apr 10 13:19:02 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 1G" returned: 0 in 0.568s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:02 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 Apr 10 13:19:02 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:02 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821" returned: 0 in 0.523s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:02 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 Apr 10 13:19:02 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:03 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165" returned: 0 in 0.519s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:03 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:03 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 Apr 10 13:19:03 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:03 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7" returned: 0 in 0.501s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:03 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7 Apr 10 13:19:03 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:03 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165" returned: 0 in 0.446s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:03 devstack sudo[86105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.info Apr 10 13:19:03 devstack sudo[86105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:03 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821.ea67fcbf-b6ef-4246-8fa0-46e69897e7d7" returned: 0 in 0.450s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-ea67fcbf-b6ef-4246-8fa0-46e69897e7d7" released by "_delete_snapshot" :: held 2.012s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-72ab90c4-4874-4b27-aad7-3e42d1c00821" released by "delete_snapshot" :: held 2.023s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Created reservations ['69a833aa-96a0-4f02-ab82-87a4785b4820', '98b65f6d-9fd7-42fa-9767-8e68c1a5cdf0', 'e7c2c3b6-264d-48c0-9f60-000ee19e01c4', '434f2711-c46b-4706-9a10-149704cb5f47'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:03 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Delete snapshot completed successfully. Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-ea67fcbf-b6ef-4246-8fa0-46e69897e7d7-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Snapshots deleted, issuing volume delete {{(pid=82554) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-72ab90c4-4874-4b27-aad7-3e42d1c00821" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-72ab90c4-4874-4b27-aad7-3e42d1c00821" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af1a906-a810-4be5-900e-effefed8844b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Acquiring lock "cinder-quobyte-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Lock "cinder-quobyte-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[912e6e6c-5c66-4336-900d-4d9c25e0381b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:04 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 Apr 10 13:19:04 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:04 devstack sudo[86108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b Apr 10 13:19:04 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:04 devstack sudo[86105]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.info" returned: 0 in 0.527s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:04 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:04 devstack sudo[86122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.info Apr 10 13:19:04 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:04 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821" returned: 0 in 0.643s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:04 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821 Apr 10 13:19:04 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:04 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b" returned: 0 in 0.669s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:04 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b Apr 10 13:19:04 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:04 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.info" returned: 0 in 0.572s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Acquiring lock "cinder-quobyte-32492b00-fd20-44e5-8f62-b082569028ea" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Lock "cinder-quobyte-32492b00-fd20-44e5-8f62-b082569028ea" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] snapshot: 2a731ea1-5312-4b37-b758-fa62b478d165, volume: 32492b00-fd20-44e5-8f62-b082569028ea, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cab7429-1ba4-4332-8fb3-e454c6cce2be]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:04 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 Apr 10 13:19:04 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:05 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-72ab90c4-4874-4b27-aad7-3e42d1c00821" returned: 0 in 0.464s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-72ab90c4-4874-4b27-aad7-3e42d1c00821" released by "delete_volume" :: held 1.136s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Created reservations ['d312b4f0-21eb-4842-acb1-3e8127fc5d36', '87853ed0-8418-410c-a546-bf2ea52c82de', '07f5b31f-57f4-47f6-a83b-746dc9be6336', '95bbab9f-8c01-4f13-a9fc-a8e589d0a0cc'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:05 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:05 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:05 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b" returned: 0 in 0.492s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Lock "cinder-quobyte-a1d1ac38-4c84-4ed4-9ed2-24cf05b9917b" released by "delete_volume" :: held 1.189s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Acquiring lock "cinder-quobyte-fa09f753-f682-4f78-88e8-0e0868540ca1" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Lock "cinder-quobyte-fa09f753-f682-4f78-88e8-0e0868540ca1" acquired by "delete_volume" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9385ff-4e30-4ff0-9f3d-d2f507fe86be]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:05 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1 Apr 10 13:19:05 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:05 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165" returned: 0 in 0.508s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90a76731-55f8-4dbb-894f-757d4e8ddb28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf60af1-51b2-4052-82d7-7bccc4a521c6]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:05 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 Apr 10 13:19:05 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:05 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.453s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:05 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Deleted volume successfully. Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0e093102-fd7f-4710-897b-be71495f3016 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-72ab90c4-4874-4b27-aad7-3e42d1c00821-delete_volume" released by "delete_volume" :: held 8.395s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:05 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1" returned: 0 in 0.533s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:05 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1 Apr 10 13:19:05 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:06 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28" returned: 0 in 0.592s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:06 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea Apr 10 13:19:06 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Flow 'volume_create_manager' (6c94e2ce-bd03-426a-96c1-0b62988c4a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a19ffe-6204-4e26-9236-ef2ac63596dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:06 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a19ffe-6204-4e26-9236-ef2ac63596dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-688485536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa27d9d-099a-4d91-b83e-0de1698e661f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df75aba77f443e7bfcda22804e8f98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:06Z,use_quota=True,user_id='68e20337e07c4927a972dae384829e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936613d3-3a1d-4af0-adf3-256cb922b82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936613d3-3a1d-4af0-adf3-256cb922b82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cdb736-419e-4545-af84-bdafc0d1c4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cdb736-419e-4545-af84-bdafc0d1c4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa27d9d-099a-4d91-b83e-0de1698e661f', 'volume_name': 'volume-afa27d9d-099a-4d91-b83e-0de1698e661f', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3285bdde-133d-4eea-af0d-7d3ad76977a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3285bdde-133d-4eea-af0d-7d3ad76977a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafabfd6-4466-46b4-96f1-5d36d9078222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:06 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Volume afa27d9d-099a-4d91-b83e-0de1698e661f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa27d9d-099a-4d91-b83e-0de1698e661f', 'volume_size': 1} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fa09f753-f682-4f78-88e8-0e0868540ca1" returned: 0 in 0.540s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Lock "cinder-quobyte-fa09f753-f682-4f78-88e8-0e0868540ca1" released by "delete_volume" :: held 1.092s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Created reservations ['c9a94c8d-e3fa-4fdc-bc56-340e0ff4c248'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:06 devstack cinder-volume[82554]: WARNING cinder.quota [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-224298334 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-224298334, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:19:06 devstack cinder-volume[82554]: WARNING cinder.quota [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-224298334 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-224298334, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Created reservations ['44c0be2e-db2c-4b1b-b1a0-abcb65a2bf76', 'c8ed942e-749b-4678-8454-6753e3b391ac', 'cd726c51-1b0d-45ed-a0d9-b6ed3744d998', 'fd7b639f-f6c9-4ff8-a1d2-74d756650b9a'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=156,cinder:INSERT=51,cinder:UPDATE=144,cinder:DELETE=11 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:UPDATE=170,cinder:SELECT=156,cinder:DELETE=8,cinder:INSERT=35 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Created reservations ['110f5a87-e000-44cc-ba2c-e09750b457da', '954b5e06-119e-4344-85df-6185f924983e', '7a7c034a-181b-4ab3-8cc1-4b24d4b0dba1', '142c57ec-0a79-415b-be64-78d2c013cdc8'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:06 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:06 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:07 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 1.377s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:07 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:07 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-be019a42-e7f4-4ae2-b52a-58a61f776c52 tempest-GroupsTest-1061138109 None] Delete group completed successfully. Apr 10 13:19:08 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea" returned: 0 in 2.288s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:08 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42552a9-dd4b-40aa-b238-be85d9be6843]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:08 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 Apr 10 13:19:08 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:08 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28" returned: 0 in 0.667s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:19:09 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Converted 1024.00 MB image at 447.30 MB/s Apr 10 13:19:09 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea is being set with open permissions: ugo+rw: NotImplementedError Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:09 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea Apr 10 13:19:09 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:09 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea" returned: 0 in 0.499s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Lock "cinder-quobyte-32492b00-fd20-44e5-8f62-b082569028ea" released by "_copy_volume_from_snapshot" :: held 4.626s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Acquiring lock "cinder-quobyte-2a731ea1-5312-4b37-b758-fa62b478d165" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Lock "cinder-quobyte-2a731ea1-5312-4b37-b758-fa62b478d165" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Deleting offline snapshot 2a731ea1-5312-4b37-b758-fa62b478d165 of volume 90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] snapshot_file for this snap is: volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[922e7a06-8f24-491d-9e21-dfbb911c8848]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:09 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 Apr 10 13:19:09 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:10 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165" returned: 0 in 0.629s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90a76731-55f8-4dbb-894f-757d4e8ddb28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:10 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a3dec-93ca-40a6-a7ef-24604907edbc]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:10 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 Apr 10 13:19:10 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:10 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28" returned: 0 in 0.614s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:10 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 Apr 10 13:19:10 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Flow 'volume_create_manager' (00330d6b-b7e6-4213-bd53-a53db853a552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6e50ee-0ad9-4996-87e7-587cbad96018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6e50ee-0ad9-4996-87e7-587cbad96018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1751634286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ffffbe-76d8-493e-b677-2dae40994004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c83927c7f2464a85d7f07919eb0b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:11Z,use_quota=True,user_id='6845a8994e6146f6a5acd1d036bcc8e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f6fbe6-e565-4b01-bddc-4a3e3ab676dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f6fbe6-e565-4b01-bddc-4a3e3ab676dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57aec79-0746-44bf-a8d2-85381a4c14e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57aec79-0746-44bf-a8d2-85381a4c14e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ffffbe-76d8-493e-b677-2dae40994004', 'volume_name': 'volume-93ffffbe-76d8-493e-b677-2dae40994004', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0162748-327a-4257-85d7-8f9a85553c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0162748-327a-4257-85d7-8f9a85553c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33347087-a3bb-4e63-9c8a-b5eb9b20a976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:11 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Volume 93ffffbe-76d8-493e-b677-2dae40994004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ffffbe-76d8-493e-b677-2dae40994004', 'volume_size': 1} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:11 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165" returned: 0 in 0.575s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:11 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165 Apr 10 13:19:11 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:11 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28.2a731ea1-5312-4b37-b758-fa62b478d165" returned: 0 in 0.496s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Lock "cinder-quobyte-2a731ea1-5312-4b37-b758-fa62b478d165" released by "_delete_snapshot" :: held 2.366s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.306s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.661s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-688485536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa27d9d-099a-4d91-b83e-0de1698e661f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df75aba77f443e7bfcda22804e8f98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:06Z,use_quota=True,user_id='68e20337e07c4927a972dae384829e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Creating volume afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:11 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:11 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f 1073741824 Apr 10 13:19:11 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:11 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c232e523-0c24-4fec-ba4c-7a79ba4bf1be tempest-GroupsV314Test-424220256 None] Create group from source-group-66d7577c-265a-4b70-a7dc-77e85ac32b98 completed successfully. Apr 10 13:19:12 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f 1073741824" returned: 0 in 0.558s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:12 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f Apr 10 13:19:12 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Acquiring lock "cinder-quobyte-32492b00-fd20-44e5-8f62-b082569028ea" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Lock "cinder-quobyte-32492b00-fd20-44e5-8f62-b082569028ea" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:12 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[9863016d-178a-41b1-870f-78d973b6d5d2]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:13 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f" returned: 0 in 0.549s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.696s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1751634286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ffffbe-76d8-493e-b677-2dae40994004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c83927c7f2464a85d7f07919eb0b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:11Z,use_quota=True,user_id='6845a8994e6146f6a5acd1d036bcc8e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Creating volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:13 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:13 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:13 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafabfd6-4466-46b4-96f1-5d36d9078222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa27d9d-099a-4d91-b83e-0de1698e661f', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12dd62e5-fa0e-425f-9ca1-5dd35392fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:13 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 1073741824 Apr 10 13:19:13 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:13 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Volume volume-afa27d9d-099a-4d91-b83e-0de1698e661f (afa27d9d-099a-4d91-b83e-0de1698e661f): created successfully Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12dd62e5-fa0e-425f-9ca1-5dd35392fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Flow 'volume_create_manager' (6c94e2ce-bd03-426a-96c1-0b62988c4a16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:13 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9fb5f5d4-ee07-45f0-a47b-23faebf22497 tempest-VolumesDeleteCascade-1722811480 None] Created volume successfully. Apr 10 13:19:13 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea" returned: 0 in 0.490s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:13 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea Apr 10 13:19:13 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:13 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 1073741824" returned: 0 in 0.583s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:13 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 Apr 10 13:19:13 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:13 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-32492b00-fd20-44e5-8f62-b082569028ea" returned: 0 in 0.478s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Lock "cinder-quobyte-32492b00-fd20-44e5-8f62-b082569028ea" released by "delete_volume" :: held 0.988s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:13 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Created reservations ['27c9d05b-6e59-4713-ac96-efe67452abcf'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:14 devstack cinder-volume[82554]: WARNING cinder.quota [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1461773783 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1461773783, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:19:14 devstack cinder-volume[82554]: WARNING cinder.quota [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1461773783 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1461773783, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Created reservations ['a2400e6d-d371-4d17-8ad4-dabcba55f10b', '2e388d77-9fb3-4fc0-b87a-12e985a756a6', '7e5cf617-fa15-436e-9afe-be38b3a3ee08', '0b2de3d0-5602-4abf-a554-ee33be6583a6'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:14 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:14 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:14 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Flow 'volume_create_manager' (8f9c6b9a-a59d-4f4f-b02a-56619b5d0533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec057996-c214-4063-a5b7-7b9db93014a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004" returned: 0 in 0.557s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.389s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec057996-c214-4063-a5b7-7b9db93014a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1525858801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38efad6d-e17c-4007-98de-0d7ec6a7b8b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e03713ce86d04f64bb31261552dac5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:14Z,use_quota=True,user_id='0ba2a0163e854382892a1d9986e8b6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042d6f68-e98a-49ca-852e-d432f2fc3c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042d6f68-e98a-49ca-852e-d432f2fc3c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73eb3684-6bd1-465c-8ede-97225ee197ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73eb3684-6bd1-465c-8ede-97225ee197ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38efad6d-e17c-4007-98de-0d7ec6a7b8b9', 'volume_name': 'volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e021e0a3-a56b-4f26-a3a5-9724337536df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e021e0a3-a56b-4f26-a3a5-9724337536df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da88b6f-1980-4ab8-9fc0-55189ccbe738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:14 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Volume 38efad6d-e17c-4007-98de-0d7ec6a7b8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9', 'volume_size': 1} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Creating offline snapshot ca0ed9e9-670a-4b4b-9289-90737cc5a285 of volume afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33347087-a3bb-4e63-9c8a-b5eb9b20a976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ffffbe-76d8-493e-b677-2dae40994004', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62a5f13-22f6-4a3d-badb-608fca8a3721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15776ed-15e1-430a-8844-254d19268b75]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:14 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Volume volume-93ffffbe-76d8-493e-b677-2dae40994004 (93ffffbe-76d8-493e-b677-2dae40994004): created successfully Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62a5f13-22f6-4a3d-badb-608fca8a3721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Flow 'volume_create_manager' (00330d6b-b7e6-4213-bd53-a53db853a552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:14 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6edd42b7-ed1b-4ee8-908d-cd53d4d0788b tempest-SnapshotsActionsTest-1572286395 None] Created volume successfully. Apr 10 13:19:14 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f Apr 10 13:19:14 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:14 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.464s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:14 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1f8f6d21-c48a-47e0-9f41-1a75648cf3bf tempest-GroupsV314Test-424220256 None] Delete group completed successfully. Apr 10 13:19:14 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f" returned: 0 in 0.522s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:14 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 1G Apr 10 13:19:14 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Acquiring lock "cinder-quobyte-90a76731-55f8-4dbb-894f-757d4e8ddb28" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Lock "cinder-quobyte-90a76731-55f8-4dbb-894f-757d4e8ddb28" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:15 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[88130221-4b64-46de-ae37-afe21d06eb0a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:15 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 1G" returned: 0 in 0.520s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afa27d9d-099a-4d91-b83e-0de1698e661f -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:15 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 Apr 10 13:19:15 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:15 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afa27d9d-099a-4d91-b83e-0de1698e661f -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 Apr 10 13:19:15 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:15 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afa27d9d-099a-4d91-b83e-0de1698e661f -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285" returned: 0 in 0.433s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:15 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 is being set with open permissions: ugo+rw Apr 10 13:19:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:15 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28" returned: 0 in 0.498s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:15 devstack sudo[86268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 Apr 10 13:19:15 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:15 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28 Apr 10 13:19:15 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:16 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285" returned: 0 in 0.412s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:16 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-90a76731-55f8-4dbb-894f-757d4e8ddb28" returned: 0 in 0.407s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Lock "cinder-quobyte-90a76731-55f8-4dbb-894f-757d4e8ddb28" released by "delete_volume" :: held 0.939s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:16 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.info Apr 10 13:19:16 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Created reservations ['181ba753-d21a-45eb-879e-baee57efddeb'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Created reservations ['3e965cbf-0ffd-45ed-88f2-d3c97665490d', '4614f546-4ce4-46cb-a8f6-799ab9ce49d2', '71e217d2-fcaa-43b8-b8bc-a8b2280c9a26', '6ab098ad-1275-45bb-926c-35a321be9759'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:16 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:16 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:16 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.info" returned: 0 in 0.502s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:16 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.info is being set with open permissions: ugo+rw Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:16 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.info Apr 10 13:19:16 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:16 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.489s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:16 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:16 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-039c7abe-220b-41a4-bea3-555884638578 tempest-GroupsV314Test-424220256 None] Delete group completed successfully. Apr 10 13:19:17 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.info" returned: 0 in 0.452s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.926s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1525858801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38efad6d-e17c-4007-98de-0d7ec6a7b8b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e03713ce86d04f64bb31261552dac5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:14Z,use_quota=True,user_id='0ba2a0163e854382892a1d9986e8b6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Creating volume 38efad6d-e17c-4007-98de-0d7ec6a7b8b9 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:17 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:17 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9 1073741824 Apr 10 13:19:17 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:17 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0cd396ec-1d15-403c-b241-0392496d55be tempest-VolumesDeleteCascade-1722811480 None] Create snapshot completed successfully Apr 10 13:19:17 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9 1073741824" returned: 0 in 0.564s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:17 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9 Apr 10 13:19:17 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:18 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9" returned: 0 in 0.497s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.758s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da88b6f-1980-4ab8-9fc0-55189ccbe738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8fb83a-5d48-48bb-a0be-8dd4c8126485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Creating offline snapshot e125969b-056d-4035-8d7a-8250b2c63c66 of volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b0047-2793-4bf8-bcbb-561e5dbffd29]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:18 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Volume volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9 (38efad6d-e17c-4007-98de-0d7ec6a7b8b9): created successfully Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8fb83a-5d48-48bb-a0be-8dd4c8126485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Flow 'volume_create_manager' (8f9c6b9a-a59d-4f4f-b02a-56619b5d0533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Flow 'volume_create_manager' (21559d41-6e5e-4815-90b7-fcb755189007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adeb6bd-8518-4bc4-9dc4-bd909ac48a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:18 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-e64e4c85-1e32-4613-adc1-0754b4f671e8 tempest-VolumesTestJSON-455605809 None] Created volume successfully. Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adeb6bd-8518-4bc4-9dc4-bd909ac48a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-3454953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea76457-dfb0-44bf-b0c3-8b0aace9a75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df75aba77f443e7bfcda22804e8f98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ca0ed9e9-670a-4b4b-9289-90737cc5a285,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:18Z,use_quota=True,user_id='68e20337e07c4927a972dae384829e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f136959-7188-44bd-931c-c4d33d0908c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f136959-7188-44bd-931c-c4d33d0908c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6504c152-d319-4b77-84b6-76acbda728bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6504c152-d319-4b77-84b6-76acbda728bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1ea76457-dfb0-44bf-b0c3-8b0aace9a75e', 'volume_name': 'volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e', 'volume_size': 1, 'snapshot_id': 'ca0ed9e9-670a-4b4b-9289-90737cc5a285'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebf24bd-dd09-459b-ae4f-335ae3458fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebf24bd-dd09-459b-ae4f-335ae3458fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:18 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 Apr 10 13:19:18 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f3028f-68c3-4018-9cee-f0472fba29c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:18 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Volume 1ea76457-dfb0-44bf-b0c3-8b0aace9a75e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e', 'volume_size': 1, 'snapshot_id': 'ca0ed9e9-670a-4b4b-9289-90737cc5a285'} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:18 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004" returned: 0 in 0.620s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:19 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 1G Apr 10 13:19:19 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:19 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 1G" returned: 0 in 0.561s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:19 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:19 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Flow 'volume_create_manager' (33c72607-ee49-4d89-9bf9-351f259a2810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813f31ec-94a9-4a63-a568-58175936ff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813f31ec-94a9-4a63-a568-58175936ff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1462365248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa8c5ed-c122-42f0-8948-6efdcb1d94d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e03713ce86d04f64bb31261552dac5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:20Z,use_quota=True,user_id='0ba2a0163e854382892a1d9986e8b6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a9ffab-27e9-4f34-a68d-e50de51bcf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a9ffab-27e9-4f34-a68d-e50de51bcf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec2fed7-a5fa-475d-8467-4b554830d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec2fed7-a5fa-475d-8467-4b554830d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa8c5ed-c122-42f0-8948-6efdcb1d94d9', 'volume_name': 'volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01431442-1415-4650-ac7d-ee03d18b8c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01431442-1415-4650-ac7d-ee03d18b8c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90982bf7-401c-48ec-9973-795db37bd9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:19 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Volume 6aa8c5ed-c122-42f0-8948-6efdcb1d94d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9', 'volume_size': 1} Apr 10 13:19:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:20 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.477s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:20 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 is being set with open permissions: ugo+rw Apr 10 13:19:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:20 devstack sudo[86307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:20 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:20 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.394s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:20 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.info Apr 10 13:19:20 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:20 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.info" returned: 0 in 0.444s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:20 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.info is being set with open permissions: ugo+rw Apr 10 13:19:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:20 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.info Apr 10 13:19:20 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:21 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.info" returned: 0 in 0.408s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.991s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.835s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-ca0ed9e9-670a-4b4b-9289-90737cc5a285-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" by "_create_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-ca0ed9e9-670a-4b4b-9289-90737cc5a285-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Creating volume 1ea76457-dfb0-44bf-b0c3-8b0aace9a75e from snapshot ca0ed9e9-670a-4b4b-9289-90737cc5a285 {{(pid=82554) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:21 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-57c8c67a-8c0a-4143-a831-8f37a878e3f4 tempest-SnapshotsActionsTest-1572286395 None] Create snapshot completed successfully Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] snapshot: ca0ed9e9-670a-4b4b-9289-90737cc5a285, volume: 1ea76457-dfb0-44bf-b0c3-8b0aace9a75e, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ca8ad1-49dc-4fa6-a970-a1b73c04939b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:21 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 Apr 10 13:19:21 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:21 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285" returned: 0 in 0.499s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afa27d9d-099a-4d91-b83e-0de1698e661f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee19a9c5-7e3c-436a-9b7d-9d09fb05491a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:21 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f Apr 10 13:19:21 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:22 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f" returned: 0 in 0.518s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:22 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e Apr 10 13:19:22 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG oslo_service.periodic_task [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82554) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:22 devstack sudo[86329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:22 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:23 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.509s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:23 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:24 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" returned: 0 in 2.301s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:24 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9f6505-9c95-4bde-a647-b291a37701e7]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:24 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f Apr 10 13:19:24 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:25 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f" returned: 0 in 0.698s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:19:25 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Converted 1024.00 MB image at 444.81 MB/s Apr 10 13:19:25 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e is being set with open permissions: ugo+rw Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:25 devstack sudo[86348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e Apr 10 13:19:25 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:25 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" returned: 0 in 0.472s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" released by "_copy_volume_from_snapshot" :: held 4.544s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-ca0ed9e9-670a-4b4b-9289-90737cc5a285-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" released by "_create_volume_from_snapshot" :: held 4.562s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.579s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.016s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1462365248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa8c5ed-c122-42f0-8948-6efdcb1d94d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e03713ce86d04f64bb31261552dac5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:20Z,use_quota=True,user_id='0ba2a0163e854382892a1d9986e8b6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Creating volume 6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:25 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:25 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 1073741824 Apr 10 13:19:25 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f3028f-68c3-4018-9cee-f0472fba29c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e', 'volume_size': 1, 'snapshot_id': 'ca0ed9e9-670a-4b4b-9289-90737cc5a285'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef807e1-c4fb-49f2-ac0f-95a716a5ae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:25 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Volume volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e (1ea76457-dfb0-44bf-b0c3-8b0aace9a75e): created successfully Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef807e1-c4fb-49f2-ac0f-95a716a5ae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Flow 'volume_create_manager' (21559d41-6e5e-4815-90b7-fcb755189007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:25 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9f427b53-579d-457f-97a0-0a4d9e17b53f tempest-VolumesDeleteCascade-1722811480 None] Created volume successfully. Apr 10 13:19:26 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 1073741824" returned: 0 in 0.561s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:26 devstack sudo[86356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 Apr 10 13:19:26 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-afa27d9d-099a-4d91-b83e-0de1698e661f-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-afa27d9d-099a-4d91-b83e-0de1698e661f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:26 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Performing cascade delete. {{(pid=82554) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9" returned: 0 in 0.426s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.779s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90982bf7-401c-48ec-9973-795db37bd9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1ef108-e31b-4eae-b4de-65f2f50118ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-ca0ed9e9-670a-4b4b-9289-90737cc5a285-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:26 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Volume volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 (6aa8c5ed-c122-42f0-8948-6efdcb1d94d9): created successfully Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1ef108-e31b-4eae-b4de-65f2f50118ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Flow 'volume_create_manager' (33c72607-ee49-4d89-9bf9-351f259a2810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] Creating offline snapshot b05faf4e-4012-44fc-afd7-afca272b3e5e of volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-ca0ed9e9-670a-4b4b-9289-90737cc5a285-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6824292-84be-4989-b2cb-1a6e5d949a00]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:26 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-09501aab-ad53-4768-922a-70a7a37c19c2 tempest-VolumesTestJSON-455605809 None] Created volume successfully. Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-afa27d9d-099a-4d91-b83e-0de1698e661f" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-afa27d9d-099a-4d91-b83e-0de1698e661f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-ca0ed9e9-670a-4b4b-9289-90737cc5a285" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-ca0ed9e9-670a-4b4b-9289-90737cc5a285" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Deleting offline snapshot ca0ed9e9-670a-4b4b-9289-90737cc5a285 of volume afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] snapshot_file for this snap is: volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8762df2-4b22-47fd-9a70-b1cb00ac345b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:27 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:27 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:27 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 Apr 10 13:19:27 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:27 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.586s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:27 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285" returned: 0 in 0.562s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afa27d9d-099a-4d91-b83e-0de1698e661f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:27 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e 1G Apr 10 13:19:27 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e6e4b7-ebc2-423d-8ddb-9533c06843a5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Flow 'volume_create_manager' (cc4d01f3-fcdc-4b2e-b180-26d4b38c75a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4004d3-6383-4100-89a8-72b68012f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4004d3-6383-4100-89a8-72b68012f36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-950478417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d503aa-ff79-4cf4-85cd-236ee20a45ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e03713ce86d04f64bb31261552dac5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:28Z,use_quota=True,user_id='0ba2a0163e854382892a1d9986e8b6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6e7d3d-07ff-4d2b-918f-486fb9b53838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6e7d3d-07ff-4d2b-918f-486fb9b53838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0603426-fd81-42d4-8cfe-3c567bac4f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0603426-fd81-42d4-8cfe-3c567bac4f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d503aa-ff79-4cf4-85cd-236ee20a45ee', 'volume_name': 'volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cc4ee4-5d4f-4666-a77b-0fb592f8aed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cc4ee4-5d4f-4666-a77b-0fb592f8aed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28835510-c386-408e-a544-dab345cde4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:27 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Volume 22d503aa-ff79-4cf4-85cd-236ee20a45ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee', 'volume_size': 1} Apr 10 13:19:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:27 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f Apr 10 13:19:27 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:28 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f" returned: 0 in 0.557s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:28 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e 1G" returned: 0 in 0.624s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:28 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 Apr 10 13:19:28 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:28 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e Apr 10 13:19:28 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:28 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e" returned: 0 in 0.526s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:28 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e is being set with open permissions: ugo+rw Apr 10 13:19:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:28 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285" returned: 0 in 0.568s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:28 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e Apr 10 13:19:28 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:28 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285 Apr 10 13:19:28 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:29 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f.ca0ed9e9-670a-4b4b-9289-90737cc5a285" returned: 0 in 0.403s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-ca0ed9e9-670a-4b4b-9289-90737cc5a285" released by "_delete_snapshot" :: held 2.145s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-afa27d9d-099a-4d91-b83e-0de1698e661f" released by "delete_snapshot" :: held 2.161s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Created reservations ['ecacb402-5181-4fd7-a2ea-21625586c16e', '10a90d83-7f24-4f95-8154-b4ade14f1ee3', '0d454e14-3adc-49e4-bfce-26ed36830056', '71fd7350-4c2b-4e2b-80cd-c1ec6479941a'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:29 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Delete snapshot completed successfully. Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-ca0ed9e9-670a-4b4b-9289-90737cc5a285-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Snapshots deleted, issuing volume delete {{(pid=82554) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-afa27d9d-099a-4d91-b83e-0de1698e661f" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:29 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e" returned: 0 in 0.541s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-afa27d9d-099a-4d91-b83e-0de1698e661f" acquired by "delete_volume" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a39d6da-7733-4c48-b255-4c3a16019888]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.590s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-950478417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d503aa-ff79-4cf4-85cd-236ee20a45ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e03713ce86d04f64bb31261552dac5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:28Z,use_quota=True,user_id='0ba2a0163e854382892a1d9986e8b6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Creating volume 22d503aa-ff79-4cf4-85cd-236ee20a45ee {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:29 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:29 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee 1073741824 Apr 10 13:19:29 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:29 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-24bd9b3e-740a-46b4-abeb-0177824283da tempest-SnapshotsActionsTest-1572286395 None] Create snapshot completed successfully Apr 10 13:19:29 devstack sudo[86402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f Apr 10 13:19:29 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-b05faf4e-4012-44fc-afd7-afca272b3e5e-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-b05faf4e-4012-44fc-afd7-afca272b3e5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-quobyte-b05faf4e-4012-44fc-afd7-afca272b3e5e" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-b05faf4e-4012-44fc-afd7-afca272b3e5e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Deleting offline snapshot b05faf4e-4012-44fc-afd7-afca272b3e5e of volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] snapshot_file for this snap is: volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79f9b78-a5fa-4777-ba33-5eb135e17b74]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:29 devstack sudo[86405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e Apr 10 13:19:29 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:29 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f" returned: 0 in 0.630s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:29 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee 1073741824" returned: 0 in 0.653s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:29 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f Apr 10 13:19:29 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:29 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee Apr 10 13:19:29 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:30 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e" returned: 0 in 0.577s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8216d9af-e308-4510-a88a-d2da860b51eb]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:30 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:30 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:30 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-afa27d9d-099a-4d91-b83e-0de1698e661f" returned: 0 in 0.477s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-afa27d9d-099a-4d91-b83e-0de1698e661f" released by "delete_volume" :: held 1.165s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Created reservations ['152cc4bf-14cf-43c4-b9dc-3dc09fd30a36', 'f0953825-ffd2-4be1-a08b-37f0b80aafbc', 'dad45107-5955-40f0-b652-b534c05573da', '8387adde-53b0-40ea-beb8-26c4b2e90fc8'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:30 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee" returned: 0 in 0.503s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28835510-c386-408e-a544-dab345cde4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466f001b-3147-45c4-b1b3-13ceb4559ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:30 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Volume volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee (22d503aa-ff79-4cf4-85cd-236ee20a45ee): created successfully Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466f001b-3147-45c4-b1b3-13ceb4559ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Flow 'volume_create_manager' (cc4d01f3-fcdc-4b2e-b180-26d4b38c75a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:30 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a010ab73-4ff0-4938-b924-e26ca1a07b18 tempest-VolumesTestJSON-455605809 None] Created volume successfully. Apr 10 13:19:30 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:30 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:30 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.672s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:30 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e Apr 10 13:19:30 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:31 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.493s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:31 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Deleted volume successfully. Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04037b39-8dbc-4941-b7cd-1217bb550bd7 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-afa27d9d-099a-4d91-b83e-0de1698e661f-delete_volume" released by "delete_volume" :: held 4.180s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "cinder-quobyte-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[134afdd1-0888-4a4a-b24f-17ae9235ce59]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:31 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e Apr 10 13:19:31 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Flow 'volume_create_manager' (1adf3f39-ac2e-42cd-9cde-73ebf85e5182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70080a2-4bb5-4726-a021-f8c066182885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70080a2-4bb5-4726-a021-f8c066182885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1141522493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd0bd85-a788-464b-9f61-da71e75c291a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='805b190891ff4f33922d5452c8b9c41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:31Z,use_quota=True,user_id='e3ac9ccb9d40400eae030f0a17300cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20587872-eca9-4fa6-8fe5-ff3900234602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20587872-eca9-4fa6-8fe5-ff3900234602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ac865c-18fb-4eed-98f6-2b196b273dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ac865c-18fb-4eed-98f6-2b196b273dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd0bd85-a788-464b-9f61-da71e75c291a', 'volume_name': 'volume-0fd0bd85-a788-464b-9f61-da71e75c291a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d517e25-d62b-4d3c-b751-b6727a91593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d517e25-d62b-4d3c-b751-b6727a91593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463e8a09-e301-4934-8db2-08050a464007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:31 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Volume 0fd0bd85-a788-464b-9f61-da71e75c291a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd0bd85-a788-464b-9f61-da71e75c291a', 'volume_size': 1} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1141522493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd0bd85-a788-464b-9f61-da71e75c291a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='805b190891ff4f33922d5452c8b9c41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:31Z,use_quota=True,user_id='e3ac9ccb9d40400eae030f0a17300cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Creating volume 0fd0bd85-a788-464b-9f61-da71e75c291a {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:31 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:31 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e" returned: 0 in 0.671s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:31 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a 1073741824 Apr 10 13:19:31 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Acquiring lock "cinder-22d503aa-ff79-4cf4-85cd-236ee20a45ee-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:31 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e Apr 10 13:19:31 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Lock "cinder-22d503aa-ff79-4cf4-85cd-236ee20a45ee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Acquiring lock "cinder-quobyte-22d503aa-ff79-4cf4-85cd-236ee20a45ee" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Lock "cinder-quobyte-22d503aa-ff79-4cf4-85cd-236ee20a45ee" acquired by "delete_volume" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33c1759-cfb5-4dca-b858-5217bda682f0]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:31 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee Apr 10 13:19:31 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:32 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" returned: 0 in 0.600s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:32 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e Apr 10 13:19:32 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:32 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.b05faf4e-4012-44fc-afd7-afca272b3e5e" returned: 0 in 0.510s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-b05faf4e-4012-44fc-afd7-afca272b3e5e" released by "_delete_snapshot" :: held 2.490s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" released by "delete_snapshot" :: held 2.505s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:32 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a 1073741824" returned: 0 in 0.567s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Created reservations ['cb0b1a6b-db56-49f2-8297-b3b94bfdaac1', 'd3d9c10e-c465-47d1-a2f2-3e2fe486f54c', '99d84de8-936e-4948-b746-147c74dcdaf9', '065a1897-fa93-47c0-8858-4bd7fb7e8964'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:32 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a Apr 10 13:19:32 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:32 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee" returned: 0 in 0.514s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:32 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee Apr 10 13:19:32 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:32 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Delete snapshot completed successfully. Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f1bf52c8-9090-401a-ab9e-3b340f1d9091 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-b05faf4e-4012-44fc-afd7-afca272b3e5e-delete_snapshot" released by "delete_snapshot" :: held 2.659s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:32 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" returned: 0 in 0.436s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-quobyte-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e" released by "delete_volume" :: held 1.058s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Created reservations ['87e5cb4e-0b52-4681-a55e-ba9a487f13ef', '06d9de87-102a-4feb-a545-90bef4dac1db', '0b9704e9-9be5-4848-86f1-93a0d2537584', 'f5bc49bd-cdac-443c-b9c0-00a56a6fd1c0'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:32 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:32 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:32 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a" returned: 0 in 0.431s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463e8a09-e301-4934-8db2-08050a464007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd0bd85-a788-464b-9f61-da71e75c291a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7841b2-ea8f-4659-a6c8-0ba0c94a91eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:32 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Volume volume-0fd0bd85-a788-464b-9f61-da71e75c291a (0fd0bd85-a788-464b-9f61-da71e75c291a): created successfully Apr 10 13:19:32 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7841b2-ea8f-4659-a6c8-0ba0c94a91eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Flow 'volume_create_manager' (1adf3f39-ac2e-42cd-9cde-73ebf85e5182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-22d503aa-ff79-4cf4-85cd-236ee20a45ee" returned: 0 in 0.439s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:32 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-641faa30-dff7-44f9-b760-851cd43f1d0f tempest-VolumeQuotasAdminTestJSON-23536363 None] Created volume successfully. Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Lock "cinder-quobyte-22d503aa-ff79-4cf4-85cd-236ee20a45ee" released by "delete_volume" :: held 0.984s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Created reservations ['fda9b977-ab56-43a2-a2ed-b7b37713afb4', '29aeb75e-bd37-46ab-b2f8-756eca71e93e', 'a891b237-9f60-4d31-877b-66e63523a04b', '9d7439b0-cfd7-491e-b97b-b8f561a5c847'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:32 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:32 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] Creating offline snapshot 3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff of volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ca3bb3-0a3e-4639-b54d-d63f5e4cf2f0]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:33 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.467s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:33 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Deleted volume successfully. Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8b574622-60d0-43ac-ac27-b2323ef38388 tempest-VolumesDeleteCascade-1722811480 None] Lock "cinder-1ea76457-dfb0-44bf-b0c3-8b0aace9a75e-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:33 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:33 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:33 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.442s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:33 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Deleted volume successfully. Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-985fd871-0efd-4e16-8792-00cd7e1d51c8 tempest-VolumesTestJSON-455605809 None] Lock "cinder-22d503aa-ff79-4cf4-85cd-236ee20a45ee-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:33 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.480s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:33 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff 1G Apr 10 13:19:33 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Acquiring lock "cinder-0fd0bd85-a788-464b-9f61-da71e75c291a-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "cinder-0fd0bd85-a788-464b-9f61-da71e75c291a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Acquiring lock "cinder-quobyte-0fd0bd85-a788-464b-9f61-da71e75c291a" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "cinder-quobyte-0fd0bd85-a788-464b-9f61-da71e75c291a" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f8659-00ee-4758-b879-f5b6e14805e1]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Acquiring lock "cinder-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Lock "cinder-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:33 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a Apr 10 13:19:33 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Acquiring lock "cinder-quobyte-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Lock "cinder-quobyte-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbb89a1-eeba-49b6-b828-36bbc6bb1eae]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:34 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 Apr 10 13:19:34 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:34 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff 1G" returned: 0 in 0.608s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:34 devstack sudo[86484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff Apr 10 13:19:34 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:34 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a" returned: 0 in 0.620s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:34 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a Apr 10 13:19:34 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:34 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9" returned: 0 in 0.624s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:34 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9 Apr 10 13:19:34 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:34 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff" returned: 0 in 0.507s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:34 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff is being set with open permissions: ugo+rw Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:34 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff Apr 10 13:19:34 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:34 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0fd0bd85-a788-464b-9f61-da71e75c291a" returned: 0 in 0.517s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "cinder-quobyte-0fd0bd85-a788-464b-9f61-da71e75c291a" released by "delete_volume" :: held 1.164s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Created reservations ['4c39364c-78b4-45a4-9b6b-5393c5bfaffa', '0e807d0b-7596-4c49-8029-f8fbc1b30bc6', '2e5995f2-34a1-49a9-a385-1ae4bf81b16a', '74ac7460-ebb7-40c1-81ef-b6527038a701'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:35 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:35 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:35 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9" returned: 0 in 0.520s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Lock "cinder-quobyte-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9" released by "delete_volume" :: held 1.179s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Created reservations ['b797da77-0378-43f3-a45d-5f53637b4932', 'a31780bf-61a4-4ed6-b245-08b62e96658b', 'ad531870-a57c-407d-9ce2-f5f805a11e93', 'bebd4284-ca13-4308-bb3b-aea1a79b11fa'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:35 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff" returned: 0 in 0.530s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:35 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-bcf3180d-397a-45e2-8bcb-f17672433f3f tempest-SnapshotsActionsTest-1572286395 None] Create snapshot completed successfully Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:35 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:35 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:35 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.460s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:35 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Deleted volume successfully. Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07ed9dd9-3b0c-447a-9d8c-659de71b8f8b tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "cinder-0fd0bd85-a788-464b-9f61-da71e75c291a-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:35 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (a360a7b4-9919-4e54-bcd7-7619ff1c23a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6481d6-c896-412f-bba8-6d75ce7ceda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.486s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:35 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Deleted volume successfully. Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6481d6-c896-412f-bba8-6d75ce7ceda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-704579700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552e5029-1881-42d5-afd9-5fc7206aeba9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:36Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07f93a8-f9f3-4409-a4e3-c720355d05de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07f93a8-f9f3-4409-a4e3-c720355d05de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601740a5-5de5-4e87-825f-75864b9207a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601740a5-5de5-4e87-825f-75864b9207a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '552e5029-1881-42d5-afd9-5fc7206aeba9', 'volume_name': 'volume-552e5029-1881-42d5-afd9-5fc7206aeba9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779fd9e9-f731-4795-b83e-a3d4ec4ae5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779fd9e9-f731-4795-b83e-a3d4ec4ae5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6019ff3d-0999-4c78-a718-0d7072dbbba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:35 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Volume 552e5029-1881-42d5-afd9-5fc7206aeba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-552e5029-1881-42d5-afd9-5fc7206aeba9', 'volume_size': 1} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-704579700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552e5029-1881-42d5-afd9-5fc7206aeba9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:36Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Creating volume 552e5029-1881-42d5-afd9-5fc7206aeba9 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:35 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0c8faae6-ec7f-4519-9254-2ef401504ae0 tempest-VolumesTestJSON-455605809 None] Lock "cinder-6aa8c5ed-c122-42f0-8948-6efdcb1d94d9-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:35 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9 1073741824 Apr 10 13:19:35 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Acquiring lock "cinder-38efad6d-e17c-4007-98de-0d7ec6a7b8b9-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Lock "cinder-38efad6d-e17c-4007-98de-0d7ec6a7b8b9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Acquiring lock "cinder-quobyte-38efad6d-e17c-4007-98de-0d7ec6a7b8b9" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Lock "cinder-quobyte-38efad6d-e17c-4007-98de-0d7ec6a7b8b9" acquired by "delete_volume" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2815b184-a835-45fa-baad-ad7db577a842]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Flow 'volume_create_manager' (6bcd71a8-2355-47d4-8750-4015cee638a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402439e3-a04e-46ef-8fa6-69ead39338eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:36 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9 Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402439e3-a04e-46ef-8fa6-69ead39338eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1333801602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='805b190891ff4f33922d5452c8b9c41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:36Z,use_quota=True,user_id='e3ac9ccb9d40400eae030f0a17300cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:36 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433d8ae4-e51e-4c1c-b64e-03dde208a126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433d8ae4-e51e-4c1c-b64e-03dde208a126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b646fd8e-1903-474c-ae21-159c1283e9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b646fd8e-1903-474c-ae21-159c1283e9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c', 'volume_name': 'volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da893bb6-0849-485c-98d6-bbb30a6def8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da893bb6-0849-485c-98d6-bbb30a6def8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ebf905-ee08-4488-91aa-281101ea59ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:36 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Volume c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c', 'volume_size': 1} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-quobyte-3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Deleting offline snapshot 3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff of volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:19:36 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] snapshot_file for this snap is: volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9 1073741824" returned: 0 in 0.612s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f08a9b-a91a-4b16-be40-76b39c7a4490]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:36 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9 Apr 10 13:19:36 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:36 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff Apr 10 13:19:36 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:36 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9" returned: 0 in 0.557s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:36 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9 Apr 10 13:19:36 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:36 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9" returned: 0 in 0.444s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.516s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1333801602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='805b190891ff4f33922d5452c8b9c41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:36Z,use_quota=True,user_id='e3ac9ccb9d40400eae030f0a17300cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Creating volume c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:36 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6019ff3d-0999-4c78-a718-0d7072dbbba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-552e5029-1881-42d5-afd9-5fc7206aeba9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309d7359-d0da-4ec1-ac11-89a12f024f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:36 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c 1073741824 Apr 10 13:19:36 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff" returned: 0 in 0.530s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:36 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:36 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Volume volume-552e5029-1881-42d5-afd9-5fc7206aeba9 (552e5029-1881-42d5-afd9-5fc7206aeba9): created successfully Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309d7359-d0da-4ec1-ac11-89a12f024f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (a360a7b4-9919-4e54-bcd7-7619ff1c23a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a218cd9-bc19-4186-b7b8-30a7b9c627aa]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:36 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8981c4a5-62de-4728-8175-8670bb9276c5 tempest-VolumesGetTest-349999875 None] Created volume successfully. Apr 10 13:19:37 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:37 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:37 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-38efad6d-e17c-4007-98de-0d7ec6a7b8b9" returned: 0 in 0.488s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Lock "cinder-quobyte-38efad6d-e17c-4007-98de-0d7ec6a7b8b9" released by "delete_volume" :: held 1.096s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Created reservations ['df663cb5-2905-4c52-afe7-051e99733886', 'acf330b8-f15f-4aeb-a131-836607c93c84', '429aa918-f35f-427a-8a2c-f74d1e66167e', '608e6c25-a0d1-40e7-9ef8-67aa62121069'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:37 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:37 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:37 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c 1073741824" returned: 0 in 0.565s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:37 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c Apr 10 13:19:37 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:37 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.604s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:37 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff Apr 10 13:19:37 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:37 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.457s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:37 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Deleted volume successfully. Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8d6d7bf3-85de-4843-aa35-c6e2003865fa tempest-VolumesTestJSON-455605809 None] Lock "cinder-38efad6d-e17c-4007-98de-0d7ec6a7b8b9-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:37 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c" returned: 0 in 0.511s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ebf905-ee08-4488-91aa-281101ea59ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50fbe85-1bf1-48f7-8bc0-9885e53e432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:37 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Volume volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c (c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c): created successfully Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50fbe85-1bf1-48f7-8bc0-9885e53e432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Flow 'volume_create_manager' (6bcd71a8-2355-47d4-8750-4015cee638a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:37 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1105e559-ff02-49a3-93c0-3a618209747d tempest-VolumeQuotasAdminTestJSON-23536363 None] Created volume successfully. Apr 10 13:19:37 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff" returned: 0 in 0.474s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:38 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff Apr 10 13:19:38 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (c5c1a093-b52c-4569-bed8-c0519f258abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c31288b-e463-4c67-aff5-ca30c646dea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c31288b-e463-4c67-aff5-ca30c646dea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1989140823',display_name='tempest-VolumesGetTest-Volume-1088034575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3966482-93e8-425a-9a2c-2b4250d851a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:38Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4109a55a-1104-4220-b4a4-766b1d9ea225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4109a55a-1104-4220-b4a4-766b1d9ea225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c8c505-cd36-4fbb-8314-39425be666a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c8c505-cd36-4fbb-8314-39425be666a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3966482-93e8-425a-9a2c-2b4250d851a9', 'volume_name': 'volume-d3966482-93e8-425a-9a2c-2b4250d851a9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee4c087-e62f-4e73-89d8-3d6879f853ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee4c087-e62f-4e73-89d8-3d6879f853ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab2707d-5d56-40fd-b920-90da32fd9768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:38 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Volume d3966482-93e8-425a-9a2c-2b4250d851a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3966482-93e8-425a-9a2c-2b4250d851a9', 'volume_size': 1} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1989140823',display_name='tempest-VolumesGetTest-Volume-1088034575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3966482-93e8-425a-9a2c-2b4250d851a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:38Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Creating volume d3966482-93e8-425a-9a2c-2b4250d851a9 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:38 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:38 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9 1073741824 Apr 10 13:19:38 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:38 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff" returned: 0 in 0.496s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff" released by "_delete_snapshot" :: held 2.166s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" released by "delete_snapshot" :: held 2.177s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Created reservations ['e496243f-c119-4b1f-9392-6fc77788a554', '35923d5e-f949-46f9-b622-4cc053989117', '562de906-b7d9-4ad5-8837-db9c9cf05bc7', 'c17d7421-28ca-4884-86e5-f29e4abe8430'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:38 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Delete snapshot completed successfully. Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-f8b0deee-924b-4f8f-b129-2e834b73b0e9 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-3c31b417-f5a3-4d87-9d40-39e7b1fbd7ff-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:38 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b81b0dd0-0790-4ced-94f5-7b39c944fc42 tempest-VolumeQuotasAdminTestJSON-515419829 None] Transfer volume completed successfully. Apr 10 13:19:38 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9 1073741824" returned: 0 in 0.650s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:38 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9 Apr 10 13:19:38 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:39 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9" returned: 0 in 0.532s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab2707d-5d56-40fd-b920-90da32fd9768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3966482-93e8-425a-9a2c-2b4250d851a9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddff820-5b13-40c5-ab71-cde6bbde8e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Volume volume-d3966482-93e8-425a-9a2c-2b4250d851a9 (d3966482-93e8-425a-9a2c-2b4250d851a9): created successfully Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddff820-5b13-40c5-ab71-cde6bbde8e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (c5c1a093-b52c-4569-bed8-c0519f258abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:39 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0e303f63-3328-4505-a464-1a3b5cc5654c tempest-VolumesGetTest-349999875 None] Created volume successfully. Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] Creating offline snapshot 0b27b3cc-1a52-459a-a2a8-3b61309b59ac of volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7635c10-1a77-4133-a8da-0bb1858fcfe7]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Acquiring lock "cinder-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Lock "cinder-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Acquiring lock "cinder-quobyte-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Lock "cinder-quobyte-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c" acquired by "delete_volume" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:39 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:39 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ce438c-0333-4f9e-91a6-73c2c11a2fad]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:39 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c Apr 10 13:19:39 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:40 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.584s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:40 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac 1G Apr 10 13:19:40 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:40 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c" returned: 0 in 0.577s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:40 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c Apr 10 13:19:40 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-d3966482-93e8-425a-9a2c-2b4250d851a9-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Lock "cinder-d3966482-93e8-425a-9a2c-2b4250d851a9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-quobyte-d3966482-93e8-425a-9a2c-2b4250d851a9" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-d3966482-93e8-425a-9a2c-2b4250d851a9" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fdd644-89a5-435c-9ed5-876cd9682df1]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:40 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9 Apr 10 13:19:40 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:40 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac 1G" returned: 0 in 0.648s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:40 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac Apr 10 13:19:40 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:40 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c" returned: 0 in 0.584s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Lock "cinder-quobyte-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c" released by "delete_volume" :: held 1.182s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Created reservations ['a20fb478-6251-4839-a656-b0c998f3151d', 'f6cf6c95-46f2-42f2-b34c-06a509e7cd59', '0f34c742-5b0d-490e-9909-bf50dcd3a7b8', '24bca471-abf4-46f3-8de7-4151e61bebc1'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:41 devstack sudo[86620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:41 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:41 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9" returned: 0 in 0.671s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:41 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9 Apr 10 13:19:41 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:41 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac" returned: 0 in 0.505s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:41 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac is being set with open permissions: ugo+rw Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:41 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac Apr 10 13:19:41 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:41 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.501s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Deleted volume successfully. Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-daa4436f-f38e-4159-95c0-22518fdbeed4 tempest-VolumeQuotasAdminTestJSON-1366274899 None] Lock "cinder-c0bb1ce3-52d5-4d34-8ad9-b7493fda7e8c-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:41 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d3966482-93e8-425a-9a2c-2b4250d851a9" returned: 0 in 0.463s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-d3966482-93e8-425a-9a2c-2b4250d851a9" released by "delete_volume" :: held 1.166s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Created reservations ['497c6d49-c88f-4651-bd2e-6e8642cd7d81', '0af16164-2112-430f-9b71-2cee39cb6f14', 'b7736670-03a8-4a8b-b33d-67416340d020', 'c8eb16ac-4b9b-4e85-8726-28a25a7f0d2f'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:41 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:41 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:41 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac" returned: 0 in 0.504s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b665efdc-6aa4-450e-93c1-f08ea5edaaa4 tempest-SnapshotsActionsTest-1572286395 None] Create snapshot completed successfully Apr 10 13:19:42 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.488s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:42 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Deleted volume successfully. Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-04cf9443-945f-4b90-aaac-b560f612bd28 tempest-VolumesGetTest-349999875 None] Lock "cinder-d3966482-93e8-425a-9a2c-2b4250d851a9-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-552e5029-1881-42d5-afd9-5fc7206aeba9-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Lock "cinder-552e5029-1881-42d5-afd9-5fc7206aeba9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-quobyte-552e5029-1881-42d5-afd9-5fc7206aeba9" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-552e5029-1881-42d5-afd9-5fc7206aeba9" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6449e20c-9786-484f-9475-dea4763df614]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-0b27b3cc-1a52-459a-a2a8-3b61309b59ac-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-0b27b3cc-1a52-459a-a2a8-3b61309b59ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-quobyte-0b27b3cc-1a52-459a-a2a8-3b61309b59ac" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-0b27b3cc-1a52-459a-a2a8-3b61309b59ac" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Deleting offline snapshot 0b27b3cc-1a52-459a-a2a8-3b61309b59ac of volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] snapshot_file for this snap is: volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[1080af02-f30e-4d08-8354-b882e672a159]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:42 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9 Apr 10 13:19:42 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:42 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac Apr 10 13:19:42 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:43 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:43 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9" returned: 0 in 0.705s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac" returned: 0 in 0.611s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:43 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9 Apr 10 13:19:43 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:43 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ad6b8d-0c28-4b2a-afd8-57549c83d8fd]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:43 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:43 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:44 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-552e5029-1881-42d5-afd9-5fc7206aeba9" returned: 0 in 0.593s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-552e5029-1881-42d5-afd9-5fc7206aeba9" released by "delete_volume" :: held 1.322s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:44 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.593s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:44 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac Apr 10 13:19:44 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Created reservations ['26d36eb7-9a29-4168-b6f4-0e9d9ad14e2e', 'ba444e9f-1593-4278-83b5-6eaf3847f187', 'd9ecac4d-6a95-4b23-a58c-66b3925f96eb', '81c4c072-79e7-47a8-b752-c44d4b82b414'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:44 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:44 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:44 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac" returned: 0 in 0.631s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:44 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac Apr 10 13:19:44 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:44 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.630s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:44 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Deleted volume successfully. Apr 10 13:19:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af89c3d4-b02c-44d0-bd0f-3492cb484e48 tempest-VolumesGetTest-349999875 None] Lock "cinder-552e5029-1881-42d5-afd9-5fc7206aeba9-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (89d0c2d1-e25c-48b1-875b-778da2732e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59eb454-01ba-4ff6-9c57-16e2eaf5fd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59eb454-01ba-4ff6-9c57-16e2eaf5fd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-598696933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eaec0f3-27b5-4852-97f7-d7ce7ae239ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:45Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7040e24-8e79-4b20-948e-7a723ead98ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7040e24-8e79-4b20-948e-7a723ead98ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8137a23-39c8-42ae-a8b8-bb0136cf30d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8137a23-39c8-42ae-a8b8-bb0136cf30d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eaec0f3-27b5-4852-97f7-d7ce7ae239ef', 'volume_name': 'volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d71fc28-5ff4-4a95-8b67-ab0baeada50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d71fc28-5ff4-4a95-8b67-ab0baeada50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5982cead-4469-403e-843a-de7c34e74326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:45 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Volume 2eaec0f3-27b5-4852-97f7-d7ce7ae239ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef', 'volume_size': 1} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-598696933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eaec0f3-27b5-4852-97f7-d7ce7ae239ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:45Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Creating volume 2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:45 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:45 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.0b27b3cc-1a52-459a-a2a8-3b61309b59ac" returned: 0 in 0.585s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:45 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef 1073741824 Apr 10 13:19:45 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-0b27b3cc-1a52-459a-a2a8-3b61309b59ac" released by "_delete_snapshot" :: held 2.494s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" released by "delete_snapshot" :: held 2.507s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Created reservations ['bbcf34f2-2148-45d0-94c7-e3c95b8b0c55', '16dc9652-c782-4c9d-af97-4cb200616fe0', '14327dcb-bc12-4552-bf80-c4d124059656', 'c6fa6acf-3b44-4bc2-8b88-c331483cec57'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:45 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Delete snapshot completed successfully. Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-bb193a52-e209-4053-875d-4eed595c7fd0 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-0b27b3cc-1a52-459a-a2a8-3b61309b59ac-delete_snapshot" released by "delete_snapshot" :: held 2.629s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:45 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef 1073741824" returned: 0 in 0.584s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:45 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef Apr 10 13:19:45 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:46 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef" returned: 0 in 0.606s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.300s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] Creating offline snapshot 2bd944ff-c820-46d2-bfee-68c33c145490 of volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5982cead-4469-403e-843a-de7c34e74326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173ca0f1-1df5-49be-85db-d5caedafb30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52cd0fb-9c4e-4b90-8f04-b697d53fc2b0]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:46 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Volume volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef (2eaec0f3-27b5-4852-97f7-d7ce7ae239ef): created successfully Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173ca0f1-1df5-49be-85db-d5caedafb30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (89d0c2d1-e25c-48b1-875b-778da2732e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:46 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b55d3b6c-7143-46d6-8465-616f3be72377 tempest-VolumesGetTest-349999875 None] Created volume successfully. Apr 10 13:19:46 devstack sudo[86675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:46 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Flow 'volume_create_manager' (96600677-bc1e-4f55-88aa-b00e7bdbd995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930fbfe2-ec61-4bef-8207-18ceb6cda03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930fbfe2-ec61-4bef-8207-18ceb6cda03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-938217648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9cb7cb-a567-4869-9812-a0be8b2030b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01069ba1cf84568ad15ce705f577866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:47Z,use_quota=True,user_id='ad37d7d10b6d461aab238a549256487b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a2cdb0-1ae9-412c-ad41-64762422e6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a2cdb0-1ae9-412c-ad41-64762422e6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818b7f7b-0a8a-4323-a3d3-d1026ddc3528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818b7f7b-0a8a-4323-a3d3-d1026ddc3528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f9cb7cb-a567-4869-9812-a0be8b2030b8', 'volume_name': 'volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d9b580-a0f0-4213-969f-171d55e0be89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d9b580-a0f0-4213-969f-171d55e0be89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035604a8-8f0a-4d0c-8115-ba1d6ecf47c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:46 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Volume 1f9cb7cb-a567-4869-9812-a0be8b2030b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8', 'volume_size': 1} Apr 10 13:19:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:47 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.556s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:47 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 1G Apr 10 13:19:47 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (7cc23ee0-a276-43a4-a00a-34dc84a91c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dc7410-803a-428a-882b-5696b74e4582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dc7410-803a-428a-882b-5696b74e4582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2103531226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0e2cee-35b7-4740-b092-a6e7a576ce92,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2eaec0f3-27b5-4852-97f7-d7ce7ae239ef,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:48Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de2a068-ba2c-4dfa-bce8-706adf83ad91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de2a068-ba2c-4dfa-bce8-706adf83ad91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4ea2d6-f9ef-4387-a514-e9b83f20b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4ea2d6-f9ef-4387-a514-e9b83f20b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0c0e2cee-35b7-4740-b092-a6e7a576ce92', 'volume_name': 'volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92', 'volume_size': 1, 'source_volid': '2eaec0f3-27b5-4852-97f7-d7ce7ae239ef', 'source_volstatus': 'available'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa926b8d-a83a-4db3-a25c-27ae98e1e03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa926b8d-a83a-4db3-a25c-27ae98e1e03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13ce78e-63d5-4a1c-a7cf-f8d02111e86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:47 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Volume 0c0e2cee-35b7-4740-b092-a6e7a576ce92: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92', 'volume_size': 1, 'source_volid': '2eaec0f3-27b5-4852-97f7-d7ce7ae239ef', 'source_volstatus': 'available'} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:47 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 1G" returned: 0 in 0.612s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:47 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 Apr 10 13:19:47 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:48 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490" returned: 0 in 0.443s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:48 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 is being set with open permissions: ugo+rw Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:48 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 Apr 10 13:19:48 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:48 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490" returned: 0 in 0.437s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.746s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-938217648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9cb7cb-a567-4869-9812-a0be8b2030b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01069ba1cf84568ad15ce705f577866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:47Z,use_quota=True,user_id='ad37d7d10b6d461aab238a549256487b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Creating volume 1f9cb7cb-a567-4869-9812-a0be8b2030b8 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:48 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:48 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ef5f301d-08b2-4579-bd49-da4c5d3aa705 tempest-SnapshotsActionsTest-1572286395 None] Create snapshot completed successfully Apr 10 13:19:48 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8 1073741824 Apr 10 13:19:48 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:49 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8 1073741824" returned: 0 in 0.545s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:49 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8 Apr 10 13:19:49 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-2bd944ff-c820-46d2-bfee-68c33c145490-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-2bd944ff-c820-46d2-bfee-68c33c145490-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Acquiring lock "cinder-quobyte-2bd944ff-c820-46d2-bfee-68c33c145490" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-2bd944ff-c820-46d2-bfee-68c33c145490" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Deleting offline snapshot 2bd944ff-c820-46d2-bfee-68c33c145490 of volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] snapshot_file for this snap is: volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944beab-9259-4334-86ad-4fc537e9f3bb]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:49 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 Apr 10 13:19:49 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:49 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8" returned: 0 in 0.446s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.970s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:49 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Cloning volume 2eaec0f3-27b5-4852-97f7-d7ce7ae239ef to volume 0c0e2cee-35b7-4740-b092-a6e7a576ce92 Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035604a8-8f0a-4d0c-8115-ba1d6ecf47c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2a4028-586e-48a0-a070-dc97ffb01eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Creating offline snapshot 93486d84-8766-4889-936d-fa61e2336045 of volume 2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:19:49 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Volume volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8 (1f9cb7cb-a567-4869-9812-a0be8b2030b8): created successfully Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2a4028-586e-48a0-a070-dc97ffb01eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Flow 'volume_create_manager' (96600677-bc1e-4f55-88aa-b00e7bdbd995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f63cb7f-cba3-45d4-b783-7c0085c972da]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:49 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-60fcc5f3-7ffe-4d09-842e-7f67ac9d04ee tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Created volume successfully. Apr 10 13:19:49 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef Apr 10 13:19:49 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:50 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490" returned: 0 in 0.568s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e395f09e-53ba-45b2-9082-456c2ea0092b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:50 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:50 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:50 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef" returned: 0 in 0.564s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:50 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 1G Apr 10 13:19:50 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:50 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.589s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:50 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 Apr 10 13:19:50 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Acquiring lock "cinder-1f9cb7cb-a567-4869-9812-a0be8b2030b8-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Lock "cinder-1f9cb7cb-a567-4869-9812-a0be8b2030b8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Acquiring lock "cinder-quobyte-1f9cb7cb-a567-4869-9812-a0be8b2030b8" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Lock "cinder-quobyte-1f9cb7cb-a567-4869-9812-a0be8b2030b8" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d4f4a5-e502-4dc2-a262-565258284db5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:50 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8 Apr 10 13:19:50 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:50 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 1G" returned: 0 in 0.600s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:50 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 Apr 10 13:19:50 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Flow 'volume_create_manager' (ac0309b7-2e22-429e-a6f7-165193bd18ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7044bd48-729c-4bc5-b2ad-3abbb38357a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7044bd48-729c-4bc5-b2ad-3abbb38357a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2131685339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441c5d8c-26a8-4817-8527-7997defd9032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad8dc69727746ecbbac5533d2b573ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:51Z,use_quota=True,user_id='6d15d52017114018ba0cca960cf03729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b90af5-cc4c-4c58-86b0-9b8073ddcea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b90af5-cc4c-4c58-86b0-9b8073ddcea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82075efb-08c0-40c2-b3ca-8a433f3cbf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82075efb-08c0-40c2-b3ca-8a433f3cbf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441c5d8c-26a8-4817-8527-7997defd9032', 'volume_name': 'volume-441c5d8c-26a8-4817-8527-7997defd9032', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf36fe3-a2fe-4679-aca7-86c90ce41323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf36fe3-a2fe-4679-aca7-86c90ce41323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd0f0b8-a1d2-472b-9137-c824087e4aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:51 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Volume 441c5d8c-26a8-4817-8527-7997defd9032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441c5d8c-26a8-4817-8527-7997defd9032', 'volume_size': 1} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:51 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490" returned: 0 in 0.616s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:51 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8" returned: 0 in 0.530s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:51 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8 Apr 10 13:19:51 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:51 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490 Apr 10 13:19:51 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:51 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045" returned: 0 in 0.449s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:51 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 is being set with open permissions: ugo+rw Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:51 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 Apr 10 13:19:51 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:51 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.2bd944ff-c820-46d2-bfee-68c33c145490" returned: 0 in 0.428s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:51 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1f9cb7cb-a567-4869-9812-a0be8b2030b8" returned: 0 in 0.439s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-2bd944ff-c820-46d2-bfee-68c33c145490" released by "_delete_snapshot" :: held 2.267s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Lock "cinder-quobyte-1f9cb7cb-a567-4869-9812-a0be8b2030b8" released by "delete_volume" :: held 0.998s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" released by "delete_snapshot" :: held 2.282s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Created reservations ['e8f5351b-70bc-47b2-b18e-dac72ca2bea9', 'f84cf9ea-b84f-4826-b765-2a24257f3b28', '96c51bd2-9b47-4d3d-85cc-0653076b89c2', 'e22e1bec-1a08-4304-9be3-97fdfa047e30'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Created reservations ['40fdc4f5-2f34-4344-bc8a-b9bfcbb6ea83', 'f0da3d27-ca77-434f-8062-d36c624330bf', '5f16db8a-6289-4aff-8161-641d550b4e04', '7a7b1216-f881-48c6-8c3f-955ce89b4f4a'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:51 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:51 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Delete snapshot completed successfully. Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045" returned: 0 in 0.459s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:51 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6aee4996-e6f2-412f-a2bd-f270322d0fc5 tempest-SnapshotsActionsTest-2073632728 None] Lock "cinder-2bd944ff-c820-46d2-bfee-68c33c145490-delete_snapshot" released by "delete_snapshot" :: held 2.450s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:51 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:51 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.info Apr 10 13:19:51 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:52 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.407s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:52 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Deleted volume successfully. Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-23447135-bc12-4b53-b048-d75a673882d4 tempest-VolumeQuotasNegativeTestJSON-1261595931 None] Lock "cinder-1f9cb7cb-a567-4869-9812-a0be8b2030b8-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:52 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.info" returned: 0 in 0.427s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:52 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.info is being set with open permissions: ugo+rw Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:52 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.info Apr 10 13:19:52 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:52 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.info" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-quobyte-0c0e2cee-35b7-4740-b092-a6e7a576ce92" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-0c0e2cee-35b7-4740-b092-a6e7a576ce92" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] snapshot: 93486d84-8766-4889-936d-fa61e2336045, volume: 0c0e2cee-35b7-4740-b092-a6e7a576ce92, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e70acd6-fc3d-4cd2-a01d-439952a359f3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:52 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 Apr 10 13:19:52 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "cinder-e125969b-056d-4035-8d7a-8250b2c63c66-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Lock "cinder-e125969b-056d-4035-8d7a-8250b2c63c66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "cinder-quobyte-e125969b-056d-4035-8d7a-8250b2c63c66" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Lock "cinder-quobyte-e125969b-056d-4035-8d7a-8250b2c63c66" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Deleting offline snapshot e125969b-056d-4035-8d7a-8250b2c63c66 of volume 93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] snapshot_file for this snap is: volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c55d4-d491-4b4e-8d75-45a3017a7a79]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:52 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:52 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:53 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045" returned: 0 in 0.517s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d5db7a-66fe-4d08-bc38-de637d84652a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:53 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef Apr 10 13:19:53 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:53 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.551s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ffffbe-76d8-493e-b677-2dae40994004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7ae30f-c9ac-4cbc-a86a-9a18d359a398]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:53 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 Apr 10 13:19:53 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:53 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef" returned: 0 in 0.534s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:19:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:53 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 Apr 10 13:19:53 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:54 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004" returned: 0 in 0.572s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:54 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:54 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:54 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.800s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:54 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66 Apr 10 13:19:54 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:55 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004.e125969b-056d-4035-8d7a-8250b2c63c66" returned: 0 in 0.981s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Lock "cinder-quobyte-e125969b-056d-4035-8d7a-8250b2c63c66" released by "_delete_snapshot" :: held 3.011s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" released by "delete_snapshot" :: held 3.035s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:55 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Created reservations ['56fe9477-f8c7-49aa-b2f8-bc2efa5883eb', 'dc9ea20c-5130-4c85-9fca-dda1a2f25199', 'da295b2b-5e12-4bf8-9a1e-1059a881e4b9', 'b0c968f9-a51f-4922-aac2-0d8a8ac68e4b'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:56 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Delete snapshot completed successfully. Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ea2540a0-bfcf-4496-83c0-da97084b7893 tempest-SnapshotsActionsTest-1572286395 None] Lock "cinder-e125969b-056d-4035-8d7a-8250b2c63c66-delete_snapshot" released by "delete_snapshot" :: held 3.215s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "cinder-93ffffbe-76d8-493e-b677-2dae40994004-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Lock "cinder-93ffffbe-76d8-493e-b677-2dae40994004-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" acquired by "delete_volume" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fb5cdf-2c7a-4cf4-bffc-9682249c5d99]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:56 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92" returned: 0 in 2.509s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8948b189-dd72-4149-ba72-4c906992a9f3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:56 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 Apr 10 13:19:56 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:56 devstack sudo[86799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef Apr 10 13:19:56 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:56 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004" returned: 0 in 0.536s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:56 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004 Apr 10 13:19:56 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:56 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef" returned: 0 in 0.645s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:19:56 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Converted 1024.00 MB image at 407.89 MB/s Apr 10 13:19:56 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 is being set with open permissions: ugo+rw Apr 10 13:19:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:56 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 Apr 10 13:19:57 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:57 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-93ffffbe-76d8-493e-b677-2dae40994004" returned: 0 in 0.480s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Lock "cinder-quobyte-93ffffbe-76d8-493e-b677-2dae40994004" released by "delete_volume" :: held 1.071s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Flow 'volume_create_manager' (fb0d679f-cd88-4092-9cf1-ec8fb6a06c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9784d5d-8f17-4bd1-aa8e-6bdd952153a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Created reservations ['5136e1b3-cc74-4fe8-ab26-cffcc39d2ddf', 'b4fa7b81-b388-44dc-b43b-91a9fffcfabf', '5f8a0a53-6073-4994-9175-de076225a760', 'b3a4fec6-7816-4ad8-9334-4e25a9cf8b8e'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9784d5d-8f17-4bd1-aa8e-6bdd952153a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1242609022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c21542-ccb6-44b3-b3a3-9727013674e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06cdcfa5c3e4159b641f102e9e4d8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:57Z,use_quota=True,user_id='2d4db0b27b6f48cfbeda8f77a9816b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9c2a9d-ef5f-42dc-959d-061f04389fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9c2a9d-ef5f-42dc-959d-061f04389fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e09ad2-689d-43fc-9261-944cfceccd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e09ad2-689d-43fc-9261-944cfceccd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c21542-ccb6-44b3-b3a3-9727013674e5', 'volume_name': 'volume-65c21542-ccb6-44b3-b3a3-9727013674e5', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1da937-514d-4818-8aed-e342d01f2486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:57 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1da937-514d-4818-8aed-e342d01f2486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87a3e1a-a0a1-4b87-81e7-f6c6aad899d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:57 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Volume 65c21542-ccb6-44b3-b3a3-9727013674e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c21542-ccb6-44b3-b3a3-9727013674e5', 'volume_size': 1} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92" returned: 0 in 0.502s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-0c0e2cee-35b7-4740-b092-a6e7a576ce92" released by "_copy_volume_from_snapshot" :: held 4.773s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:57 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:19:57 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-quobyte-93486d84-8766-4889-936d-fa61e2336045" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-93486d84-8766-4889-936d-fa61e2336045" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Deleting offline snapshot 93486d84-8766-4889-936d-fa61e2336045 of volume 2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] snapshot_file for this snap is: volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dab71a-cf17-4550-ab56-067d042ec170]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:57 devstack sudo[86816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 Apr 10 13:19:57 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:57 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.410s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:19:57 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Deleted volume successfully. Apr 10 13:19:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb538769-c124-425f-944f-82e0873fcac0 tempest-SnapshotsActionsTest-1572286395 None] Lock "cinder-93ffffbe-76d8-493e-b677-2dae40994004-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:58 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045" returned: 0 in 0.473s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:19:58 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae775078-b88b-492e-8180-0c4d1b4363b2]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:19:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:58 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef Apr 10 13:19:58 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:58 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef" returned: 0 in 0.532s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:58 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 Apr 10 13:19:58 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:59 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045" returned: 0 in 0.507s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:59 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045 Apr 10 13:19:59 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:59 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef.93486d84-8766-4889-936d-fa61e2336045" returned: 0 in 0.446s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-93486d84-8766-4889-936d-fa61e2336045" released by "_delete_snapshot" :: held 2.000s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.851s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.474s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2131685339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441c5d8c-26a8-4817-8527-7997defd9032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad8dc69727746ecbbac5533d2b573ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:51Z,use_quota=True,user_id='6d15d52017114018ba0cca960cf03729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Creating volume 441c5d8c-26a8-4817-8527-7997defd9032 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:19:59 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13ce78e-63d5-4a1c-a7cf-f8d02111e86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92', 'volume_size': 1, 'source_volid': '2eaec0f3-27b5-4852-97f7-d7ce7ae239ef', 'source_volstatus': 'available'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66123ac-d2dd-435d-983e-a4e647126729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:19:59 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032 1073741824 Apr 10 13:19:59 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:19:59 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Volume volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 (0c0e2cee-35b7-4740-b092-a6e7a576ce92): created successfully Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66123ac-d2dd-435d-983e-a4e647126729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:19:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (7cc23ee0-a276-43a4-a00a-34dc84a91c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:19:59 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-af135a4d-86dd-420e-8ad8-503b6ef30795 tempest-VolumesGetTest-349999875 None] Created volume successfully. Apr 10 13:20:00 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032 1073741824" returned: 0 in 0.556s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:00 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032 Apr 10 13:20:00 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:00 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032" returned: 0 in 0.480s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.148s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1242609022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c21542-ccb6-44b3-b3a3-9727013674e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06cdcfa5c3e4159b641f102e9e4d8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:19:57Z,use_quota=True,user_id='2d4db0b27b6f48cfbeda8f77a9816b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Creating volume 65c21542-ccb6-44b3-b3a3-9727013674e5 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:00 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd0f0b8-a1d2-472b-9137-c824087e4aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441c5d8c-26a8-4817-8527-7997defd9032', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2ad971-e0af-4a61-a4f1-20b1a269ef2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:00 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 1073741824 Apr 10 13:20:00 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:00 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Volume volume-441c5d8c-26a8-4817-8527-7997defd9032 (441c5d8c-26a8-4817-8527-7997defd9032): created successfully Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2ad971-e0af-4a61-a4f1-20b1a269ef2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Flow 'volume_create_manager' (ac0309b7-2e22-429e-a6f7-165193bd18ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:00 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-d37d9caf-d9f7-4c76-867d-37f97c8bd2e2 tempest-VolumesServicesTestJSON-287218968 None] Created volume successfully. Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Acquiring lock "cinder-441c5d8c-26a8-4817-8527-7997defd9032-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Lock "cinder-441c5d8c-26a8-4817-8527-7997defd9032-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (0805cf9e-3a5d-4743-83d7-fa0a5aa4ee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4786f48-13d5-445f-80aa-dbb2156b430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4786f48-13d5-445f-80aa-dbb2156b430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1362589224',display_name='tempest-VolumesGetTest-Volume-1678690812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d03246-3b90-448f-acfe-24448ee61639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:01Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61068f93-aa4a-4907-80a4-f0aa4456e7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61068f93-aa4a-4907-80a4-f0aa4456e7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42dce091-17ea-478a-b20e-5fc07a4a3819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42dce091-17ea-478a-b20e-5fc07a4a3819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d03246-3b90-448f-acfe-24448ee61639', 'volume_name': 'volume-d1d03246-3b90-448f-acfe-24448ee61639', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7428c7-b1e6-4dc8-9404-e63b495debdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7428c7-b1e6-4dc8-9404-e63b495debdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260c1a04-c214-491d-a41c-e226eb0a6480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Volume d1d03246-3b90-448f-acfe-24448ee61639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d03246-3b90-448f-acfe-24448ee61639', 'volume_size': 1} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Acquiring lock "cinder-quobyte-441c5d8c-26a8-4817-8527-7997defd9032" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Lock "cinder-quobyte-441c5d8c-26a8-4817-8527-7997defd9032" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cecd9b-2e17-46df-b6e1-71af093bc484]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:01 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032 Apr 10 13:20:01 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:01 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 1073741824" returned: 0 in 0.653s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:01 devstack sudo[86853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 Apr 10 13:20:01 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Flow 'volume_create_manager' (a30fda22-c60d-4bae-9292-f0d2a3591927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf5e994-b0a8-41bd-a82a-f13e13d7a629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf5e994-b0a8-41bd-a82a-f13e13d7a629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-131353071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3037583b-cd16-43a7-9558-e80fb01673c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78d805d7a73494d89dda68da0308b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:01Z,use_quota=True,user_id='5c7861e5763642df90b4765069b143e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e024fbc3-079e-486d-9569-55f34511a261),volume_type_id=e024fbc3-079e-486d-9569-55f34511a261)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8169f32-4e31-42ba-bfe8-a15733d49c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8169f32-4e31-42ba-bfe8-a15733d49c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4e7409-a97c-47ea-8ec9-d5f2776c2e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4e7409-a97c-47ea-8ec9-d5f2776c2e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3037583b-cd16-43a7-9558-e80fb01673c7', 'volume_name': 'volume-3037583b-cd16-43a7-9558-e80fb01673c7', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec1e66a-6903-48d4-bd97-ced384cb7048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec1e66a-6903-48d4-bd97-ced384cb7048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b3c824-e67b-4573-b7a0-9a67e8243a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Volume 3037583b-cd16-43a7-9558-e80fb01673c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3037583b-cd16-43a7-9558-e80fb01673c7', 'volume_size': 1} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:01 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032" returned: 0 in 0.536s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:01 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032 Apr 10 13:20:01 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:01 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5" returned: 0 in 0.447s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1362589224',display_name='tempest-VolumesGetTest-Volume-1678690812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d03246-3b90-448f-acfe-24448ee61639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:01Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Creating volume d1d03246-3b90-448f-acfe-24448ee61639 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:01 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87a3e1a-a0a1-4b87-81e7-f6c6aad899d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c21542-ccb6-44b3-b3a3-9727013674e5', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ba2df6-ab82-46d2-9337-991598cf8eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:01 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639 1073741824 Apr 10 13:20:01 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:01 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Volume volume-65c21542-ccb6-44b3-b3a3-9727013674e5 (65c21542-ccb6-44b3-b3a3-9727013674e5): created successfully Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ba2df6-ab82-46d2-9337-991598cf8eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Flow 'volume_create_manager' (fb0d679f-cd88-4092-9cf1-ec8fb6a06c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-bbd78b0d-e4ac-4295-a048-565af4ccb099 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Created volume successfully. Apr 10 13:20:02 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-441c5d8c-26a8-4817-8527-7997defd9032" returned: 0 in 0.448s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Lock "cinder-quobyte-441c5d8c-26a8-4817-8527-7997defd9032" released by "delete_volume" :: held 1.005s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Created reservations ['abd3e387-1e1e-4a3f-847e-3808a49ba362', '2e6526eb-5f5c-4bf4-a4f9-f8794d62d614', 'ec654cf2-a424-457b-9d73-c610cd541d29', '5d212745-8550-45eb-9bf3-1d45ee321a5b'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:02 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:02 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:02 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639 1073741824" returned: 0 in 0.507s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:02 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639 Apr 10 13:20:02 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:02 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.434s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:02 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Deleted volume successfully. Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-44e2a3da-0fa2-4a61-9ce5-a890cbca82dd tempest-VolumesServicesTestJSON-287218968 None] Lock "cinder-441c5d8c-26a8-4817-8527-7997defd9032-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:02 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639" returned: 0 in 0.465s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.184s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-131353071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3037583b-cd16-43a7-9558-e80fb01673c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78d805d7a73494d89dda68da0308b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:01Z,use_quota=True,user_id='5c7861e5763642df90b4765069b143e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e024fbc3-079e-486d-9569-55f34511a261),volume_type_id=e024fbc3-079e-486d-9569-55f34511a261)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Creating volume 3037583b-cd16-43a7-9558-e80fb01673c7 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:02 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:02 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7 1073741824 Apr 10 13:20:02 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260c1a04-c214-491d-a41c-e226eb0a6480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d03246-3b90-448f-acfe-24448ee61639', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf8c8dc-7b7a-4c8d-8dca-c5fab9deba81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:02 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Volume volume-d1d03246-3b90-448f-acfe-24448ee61639 (d1d03246-3b90-448f-acfe-24448ee61639): created successfully Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf8c8dc-7b7a-4c8d-8dca-c5fab9deba81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (0805cf9e-3a5d-4743-83d7-fa0a5aa4ee11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:02 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ec4c2c20-690a-4c32-a770-1abbfce6c189 tempest-VolumesGetTest-349999875 None] Created volume successfully. Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-d1d03246-3b90-448f-acfe-24448ee61639-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Lock "cinder-d1d03246-3b90-448f-acfe-24448ee61639-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-quobyte-d1d03246-3b90-448f-acfe-24448ee61639" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-d1d03246-3b90-448f-acfe-24448ee61639" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca68b81-1762-4c32-9af3-71a917e4dca8]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:03 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7 1073741824" returned: 0 in 0.570s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:03 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639 Apr 10 13:20:03 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:03 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7 Apr 10 13:20:03 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:03 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7" returned: 0 in 0.450s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.050s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b3c824-e67b-4573-b7a0-9a67e8243a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3037583b-cd16-43a7-9558-e80fb01673c7', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4c412d-ca94-4d36-88d8-1fea98a4b5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Creating offline snapshot 3df7c8f0-5d3d-4500-a68d-5681289aced4 of volume 65c21542-ccb6-44b3-b3a3-9727013674e5 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:20:03 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Volume volume-3037583b-cd16-43a7-9558-e80fb01673c7 (3037583b-cd16-43a7-9558-e80fb01673c7): created successfully Apr 10 13:20:03 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4c412d-ca94-4d36-88d8-1fea98a4b5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Flow 'volume_create_manager' (a30fda22-c60d-4bae-9292-f0d2a3591927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9499b6-5f26-4c95-bcdf-a6947fcdc032]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639" returned: 0 in 0.580s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:03 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b20900f9-6fc7-4be5-9d63-042d659b3c32 tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Created volume successfully. Apr 10 13:20:03 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639 Apr 10 13:20:03 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:03 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 Apr 10 13:20:03 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:04 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d1d03246-3b90-448f-acfe-24448ee61639" returned: 0 in 0.494s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-d1d03246-3b90-448f-acfe-24448ee61639" released by "delete_volume" :: held 1.106s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Created reservations ['d31f88a5-23ac-48c2-9c0e-2fbb729fa100', 'ebfd041c-4646-4372-89f3-ca4305540461', '36164094-bc57-4dc8-8c8b-9972d8bfb964', '49984337-b459-46a9-a758-930cfa38c81d'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:04 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5" returned: 0 in 0.597s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:04 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:04 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:04 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 1G Apr 10 13:20:04 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-48f14c79-6edd-443c-8e23-56970366f0ef tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-48f14c79-6edd-443c-8e23-56970366f0ef tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-48f14c79-6edd-443c-8e23-56970366f0ef tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-48f14c79-6edd-443c-8e23-56970366f0ef tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-48f14c79-6edd-443c-8e23-56970366f0ef tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-48f14c79-6edd-443c-8e23-56970366f0ef tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:05 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.580s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:05 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:05 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Deleted volume successfully. Apr 10 13:20:05 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b0bba7e6-e48a-456a-8717-062ffa8df183 tempest-VolumesGetTest-349999875 None] Lock "cinder-d1d03246-3b90-448f-acfe-24448ee61639-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:05 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 1G" returned: 0 in 0.635s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c21542-ccb6-44b3-b3a3-9727013674e5 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:05 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c21542-ccb6-44b3-b3a3-9727013674e5 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 Apr 10 13:20:05 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-0c0e2cee-35b7-4740-b092-a6e7a576ce92-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:05 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-48f14c79-6edd-443c-8e23-56970366f0ef tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.488s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-48f14c79-6edd-443c-8e23-56970366f0ef tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:05 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-48f14c79-6edd-443c-8e23-56970366f0ef tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Retype volume completed successfully. Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Lock "cinder-0c0e2cee-35b7-4740-b092-a6e7a576ce92-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-quobyte-0c0e2cee-35b7-4740-b092-a6e7a576ce92" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-0c0e2cee-35b7-4740-b092-a6e7a576ce92" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e195b731-f1c0-4905-85c8-d60a564ebd94]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:05 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65c21542-ccb6-44b3-b3a3-9727013674e5 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4" returned: 0 in 0.518s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:05 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 is being set with open permissions: ugo+rw Apr 10 13:20:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:05 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 Apr 10 13:20:05 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:05 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 Apr 10 13:20:05 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:06 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4" returned: 0 in 0.430s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:06 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.info Apr 10 13:20:06 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Acquiring lock "cinder-3037583b-cd16-43a7-9558-e80fb01673c7-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "cinder-3037583b-cd16-43a7-9558-e80fb01673c7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:06 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92" returned: 0 in 0.634s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:06 devstack sudo[86920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92 Apr 10 13:20:06 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Acquiring lock "cinder-quobyte-3037583b-cd16-43a7-9558-e80fb01673c7" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "cinder-quobyte-3037583b-cd16-43a7-9558-e80fb01673c7" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[329f98e8-ed35-47cb-ab0c-4f9784944579]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:06 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7 Apr 10 13:20:06 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:06 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.info" returned: 0 in 0.494s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:06 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.info is being set with open permissions: ugo+rw Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:06 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.info Apr 10 13:20:06 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:INSERT=62,cinder:UPDATE=252,cinder:SELECT=176,cinder:DELETE=18 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=193,cinder:UPDATE=221,cinder:INSERT=48,cinder:DELETE=18 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:06 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Flow 'volume_create_manager' (41a74bdd-8658-403a-bab8-b1cdc56baf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3050a0e0-6a92-47d0-b8fb-f42dc905b368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0c0e2cee-35b7-4740-b092-a6e7a576ce92" returned: 0 in 0.554s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3050a0e0-6a92-47d0-b8fb-f42dc905b368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1287826595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf57e063-93fa-48fe-aea5-4425adb3be0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ad366404b5498e8cc2144cb9975534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:07Z,use_quota=True,user_id='40c4999a76684cd0b8ab45028204a3c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0a9c15a-87c0-46cf-ba31-f7aeed560a83),volume_type_id=a0a9c15a-87c0-46cf-ba31-f7aeed560a83)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fa825b-a3db-4d3f-8856-a3dd9cf4a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fa825b-a3db-4d3f-8856-a3dd9cf4a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5332245-ed39-4647-a8cf-4b55fd2ccbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5332245-ed39-4647-a8cf-4b55fd2ccbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf57e063-93fa-48fe-aea5-4425adb3be0b', 'volume_name': 'volume-cf57e063-93fa-48fe-aea5-4425adb3be0b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da9e771-6d4e-42aa-a1e0-33ceeaec7be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da9e771-6d4e-42aa-a1e0-33ceeaec7be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8abb510-b9fc-4213-9922-0c32af630a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:06 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Volume cf57e063-93fa-48fe-aea5-4425adb3be0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf57e063-93fa-48fe-aea5-4425adb3be0b', 'volume_size': 1} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-0c0e2cee-35b7-4740-b092-a6e7a576ce92" released by "delete_volume" :: held 1.264s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Created reservations ['1e666cb3-1b6e-4c9d-901a-b0e4e92dff3d', '6fd156db-f21f-4445-ba0b-91660feafbaa', '58940cfe-098a-4c13-b44a-60d15b9e375d', '4f37a55a-f3ae-462a-8dd9-8817fa9bafc1'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:06 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7" returned: 0 in 0.582s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:06 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7 Apr 10 13:20:06 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:06 devstack sudo[86933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:06 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:07 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.info" returned: 0 in 0.473s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.221s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.224s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1287826595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf57e063-93fa-48fe-aea5-4425adb3be0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ad366404b5498e8cc2144cb9975534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:07Z,use_quota=True,user_id='40c4999a76684cd0b8ab45028204a3c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0a9c15a-87c0-46cf-ba31-f7aeed560a83),volume_type_id=a0a9c15a-87c0-46cf-ba31-f7aeed560a83)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Creating volume cf57e063-93fa-48fe-aea5-4425adb3be0b {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:07 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:07 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b 1073741824 Apr 10 13:20:07 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:07 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-436a8338-5765-45e9-b889-0d371728c8c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Create snapshot completed successfully Apr 10 13:20:07 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3037583b-cd16-43a7-9558-e80fb01673c7" returned: 0 in 0.439s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "cinder-quobyte-3037583b-cd16-43a7-9558-e80fb01673c7" released by "delete_volume" :: held 1.046s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:07 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.437s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:07 devstack cinder-volume[82554]: WARNING cinder.quota [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:20:07 devstack cinder-volume[82554]: WARNING cinder.quota [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:20:07 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Deleted volume successfully. Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Created reservations ['29711d83-43af-4e8e-9b4c-14ca0bcc73a8', 'd9fda621-0449-423b-a707-6f3a008f4021', '2b3a71ca-078a-4f9e-a73e-33b6e2f7699c', '0a7aef8e-8585-44e9-9c38-36da01025974'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c05fa9ae-83f5-4b85-9adc-dbe3f7286a3a tempest-VolumesGetTest-349999875 None] Lock "cinder-0c0e2cee-35b7-4740-b092-a6e7a576ce92-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:07 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:07 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:07 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b 1073741824" returned: 0 in 0.520s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:07 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b Apr 10 13:20:07 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Lock "cinder-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-quobyte-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef" acquired by "delete_volume" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[804d8f9c-b40f-4775-a139-8626fc8d546a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:07 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.446s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:07 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Deleted volume successfully. Apr 10 13:20:07 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef Apr 10 13:20:07 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7243fb55-7607-4260-801e-fd4f9bf9304f tempest-VolumeRetypeWithoutMigrationTest-1814896015 None] Lock "cinder-3037583b-cd16-43a7-9558-e80fb01673c7-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:08 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b" returned: 0 in 0.495s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8abb510-b9fc-4213-9922-0c32af630a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf57e063-93fa-48fe-aea5-4425adb3be0b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0cfae1-462e-400c-aea2-c1f55a9bb46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:08 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Volume volume-cf57e063-93fa-48fe-aea5-4425adb3be0b (cf57e063-93fa-48fe-aea5-4425adb3be0b): created successfully Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0cfae1-462e-400c-aea2-c1f55a9bb46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Flow 'volume_create_manager' (41a74bdd-8658-403a-bab8-b1cdc56baf03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:08 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2ea3e381-d984-48bc-aafe-4e6c01969fe8 tempest-VolumeTypesAccessTest-1289385616 None] Created volume successfully. Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Acquiring lock "cinder-3df7c8f0-5d3d-4500-a68d-5681289aced4-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "cinder-3df7c8f0-5d3d-4500-a68d-5681289aced4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Acquiring lock "cinder-quobyte-65c21542-ccb6-44b3-b3a3-9727013674e5" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "cinder-quobyte-65c21542-ccb6-44b3-b3a3-9727013674e5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Acquiring lock "cinder-quobyte-3df7c8f0-5d3d-4500-a68d-5681289aced4" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "cinder-quobyte-3df7c8f0-5d3d-4500-a68d-5681289aced4" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Deleting offline snapshot 3df7c8f0-5d3d-4500-a68d-5681289aced4 of volume 65c21542-ccb6-44b3-b3a3-9727013674e5 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] snapshot_file for this snap is: volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bbb796-a750-48af-b0e3-31e138e6e30e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:08 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 Apr 10 13:20:08 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:08 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef" returned: 0 in 0.575s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:08 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef Apr 10 13:20:08 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:08 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4" returned: 0 in 0.565s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65c21542-ccb6-44b3-b3a3-9727013674e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[77494c6b-c93d-4edd-8c96-236388b39cc9]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:08 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef" returned: 0 in 0.510s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef" released by "delete_volume" :: held 1.123s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Created reservations ['d4f3b5b6-d70e-4c89-b389-175138f13af6', '49ed3f6f-8949-4e45-9038-e0368874dbc3', '66f93635-4cdd-4bac-a6b3-b689d869bab9', '2c782d52-54fd-4b4d-a165-a0679c16074b'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Acquiring lock "cinder-cf57e063-93fa-48fe-aea5-4425adb3be0b-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:08 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 Apr 10 13:20:08 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Lock "cinder-cf57e063-93fa-48fe-aea5-4425adb3be0b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Acquiring lock "cinder-quobyte-cf57e063-93fa-48fe-aea5-4425adb3be0b" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:09 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:09 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Lock "cinder-quobyte-cf57e063-93fa-48fe-aea5-4425adb3be0b" acquired by "delete_volume" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce140a6-75f7-42c5-9e92-14013fd712be]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:09 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b Apr 10 13:20:09 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:09 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5" returned: 0 in 0.628s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:09 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 Apr 10 13:20:09 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:09 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.546s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:09 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Deleted volume successfully. Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2d1a6502-575f-4daa-aef3-3e999fa07b25 tempest-VolumesGetTest-349999875 None] Lock "cinder-2eaec0f3-27b5-4852-97f7-d7ce7ae239ef-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:09 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b" returned: 0 in 0.608s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:09 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b Apr 10 13:20:09 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:10 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4" returned: 0 in 0.649s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:10 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4 Apr 10 13:20:10 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:10 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cf57e063-93fa-48fe-aea5-4425adb3be0b" returned: 0 in 0.528s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Lock "cinder-quobyte-cf57e063-93fa-48fe-aea5-4425adb3be0b" released by "delete_volume" :: held 1.164s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:10 devstack cinder-volume[82554]: WARNING cinder.quota [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-92554692 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-92554692, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:20:10 devstack cinder-volume[82554]: WARNING cinder.quota [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-92554692 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-92554692, it is now deprecated. Please use the default quota class for default quota. Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Created reservations ['627d8855-6211-4db8-949e-072d1aab3dcc', '7fe74c1d-8b97-4de7-afdd-0dff1b817f17', '7c476cd1-f4a6-4cfa-8aea-5b87f2cdeb59', 'd58a3790-58ed-4084-a7fc-e99f438a5360'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:10 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:10 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:10 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5.3df7c8f0-5d3d-4500-a68d-5681289aced4" returned: 0 in 0.459s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "cinder-quobyte-3df7c8f0-5d3d-4500-a68d-5681289aced4" released by "_delete_snapshot" :: held 2.382s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "cinder-quobyte-65c21542-ccb6-44b3-b3a3-9727013674e5" released by "delete_snapshot" :: held 2.394s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (8d6f0dce-4fe4-458a-be7b-e019ec88ff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22903ae-fe8f-40a8-88ee-31b66103851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22903ae-fe8f-40a8-88ee-31b66103851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-895142870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862c04a9-c90d-4694-b59b-d4a97aa23ac8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:11Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05f5749-1203-4cc1-8dcd-f1f521e978ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05f5749-1203-4cc1-8dcd-f1f521e978ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3290f469-9955-4f45-aaca-c7ab949f25db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.image.glance [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Creating Keystone auth plugin from conf {{(pid=82554) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Created reservations ['ae9209aa-1506-4a39-b60a-38472a746cb6', '058faf19-fff2-481e-85f0-f1aa1025f6ef', '495e0f70-d20c-4b00-a684-54ce7d8d9ebb', '9629ad78-36c2-4452-bfbb-ee6540332262'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:10 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Delete snapshot completed successfully. Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a05ff78a-4354-425d-8043-9a176c3c43d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "cinder-3df7c8f0-5d3d-4500-a68d-5681289aced4-delete_snapshot" released by "delete_snapshot" :: held 2.581s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:10 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.535s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:10 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Deleted volume successfully. Apr 10 13:20:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-42565fd5-7c88-4f4d-b8a1-c0c4c26818f8 tempest-VolumeTypesAccessTest-1289385616 None] Lock "cinder-cf57e063-93fa-48fe-aea5-4425adb3be0b-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3290f469-9955-4f45-aaca-c7ab949f25db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '862c04a9-c90d-4694-b59b-d4a97aa23ac8', 'volume_name': 'volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c43cbf-d2d1-4b93-93b9-61b67b6cfd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c43cbf-d2d1-4b93-93b9-61b67b6cfd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397bcdbf-f297-4088-9127-bb8affba0a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:11 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Volume 862c04a9-c90d-4694-b59b-d4a97aa23ac8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Trying to clone 862c04a9-c90d-4694-b59b-d4a97aa23ac8 from image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]). {{(pid=82554) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 13:20:11 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Image download 20.69 MB at 20.69 MB/s Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4447ca4c-7941-44ac-87ea-4d05ac968ec3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:11 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD Apr 10 13:20:11 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Acquiring lock "cinder-65c21542-ccb6-44b3-b3a3-9727013674e5-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "cinder-65c21542-ccb6-44b3-b3a3-9727013674e5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Acquiring lock "cinder-quobyte-65c21542-ccb6-44b3-b3a3-9727013674e5" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "cinder-quobyte-65c21542-ccb6-44b3-b3a3-9727013674e5" acquired by "delete_volume" :: waited 0.031s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[9435c486-97d7-47be-a774-425eb5e44986]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:11 devstack sudo[86993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 Apr 10 13:20:11 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:11 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD" returned: 0 in 0.619s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Temporary image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d is fetched for user 5a24be29751a462d8916d56e36b5994d. {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3aa6d2-5835-4653-b594-4acdde4154d7]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:11 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD Apr 10 13:20:11 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:12 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5" returned: 0 in 0.593s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:12 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5 Apr 10 13:20:12 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:12 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD" returned: 0 in 0.629s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-895142870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862c04a9-c90d-4694-b59b-d4a97aa23ac8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:11Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Creating volume 862c04a9-c90d-4694-b59b-d4a97aa23ac8 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:12 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:12 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 1073741824 Apr 10 13:20:12 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:12 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-65c21542-ccb6-44b3-b3a3-9727013674e5" returned: 0 in 0.484s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "cinder-quobyte-65c21542-ccb6-44b3-b3a3-9727013674e5" released by "delete_volume" :: held 1.121s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Created reservations ['d527be09-950e-4a76-a097-36ec6415f7ea', '486fda63-ce7e-4adc-96ca-3a8d07376d63', '2cc098f7-e97d-4939-91c6-484622246930', '788e83c6-5e87-46e3-8aba-f5402ad01144'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:12 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:12 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:13 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 1073741824" returned: 0 in 0.642s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:13 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 Apr 10 13:20:13 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:13 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.642s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:13 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Deleted volume successfully. Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c67c8602-f355-42e1-8492-3946fa8c3bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1741024733 None] Lock "cinder-65c21542-ccb6-44b3-b3a3-9727013674e5-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:13 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8" returned: 0 in 0.671s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Attempting download of 4ccac92a-bf64-4e00-af7f-9898d1d98b1d ((None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}])) to volume 862c04a9-c90d-4694-b59b-d4a97aa23ac8. {{(pid=82554) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3f53ec-2538-4369-8cef-1dec959f2576]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_39oqogid {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:14 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_39oqogid Apr 10 13:20:14 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:14 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_39oqogid" returned: 0 in 0.704s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_39oqogid {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:14 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_39oqogid Apr 10 13:20:14 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:15 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_39oqogid" returned: 1 in 0.772s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_39oqogid' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:20:15 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[480787f7-befe-4f63-a667-64c56efcb7e8]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:15 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD Apr 10 13:20:15 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:16 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD" returned: 0 in 0.596s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:16 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] 4ccac92a-bf64-4e00-af7f-9898d1d98b1d was qcow2, converting to raw {{(pid=82554) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 13:20:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:16 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 Apr 10 13:20:16 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Flow 'volume_create_manager' (d20a2338-0988-4f3c-9e2c-99bf915d8bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06367c9-ebc2-474b-b95e-bc20db1594ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06367c9-ebc2-474b-b95e-bc20db1594ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1688031003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9dba076-904a-45ad-8b4f-556453cf3864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a3edb159554c5f8aa13168b56f07bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:17Z,use_quota=True,user_id='8614e56a70024c70a7a6a7f716122bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bfcf72-8178-45ad-8f34-55ab87523d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bfcf72-8178-45ad-8f34-55ab87523d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037c3aa6-0ad9-42de-8bc3-d9e360128fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.image.glance [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Creating Keystone auth plugin from conf {{(pid=82554) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 13:20:17 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8" returned: 0 in 1.147s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_o5eqp2gqdevstack@QuobyteHD, size 112.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:20:17 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Converted 112.00 MB image at 97.59 MB/s Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:17 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 1G Apr 10 13:20:17 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037c3aa6-0ad9-42de-8bc3-d9e360128fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e9dba076-904a-45ad-8b4f-556453cf3864', 'volume_name': 'volume-e9dba076-904a-45ad-8b4f-556453cf3864', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82acd249-4a92-47ab-8ce8-90c29d6e0590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82acd249-4a92-47ab-8ce8-90c29d6e0590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21472d62-d344-4a9c-b081-5a5d19787ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:17 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Volume e9dba076-904a-45ad-8b4f-556453cf3864: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e9dba076-904a-45ad-8b4f-556453cf3864', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Trying to clone e9dba076-904a-45ad-8b4f-556453cf3864 from image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]). {{(pid=82554) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 13:20:17 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 1G" returned: 0 in 0.502s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[904730ec-a708-4d09-9be0-bced3988fae3]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:17 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 Apr 10 13:20:17 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 13:20:17 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Image download 20.69 MB at 20.69 MB/s Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3f7c07-4b1e-4166-9570-4ae29989877c]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:18 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD Apr 10 13:20:18 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:18 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8" returned: 0 in 0.604s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:18 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 Apr 10 13:20:18 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:18 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD" returned: 0 in 0.638s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Temporary image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d is fetched for user 8614e56a70024c70a7a6a7f716122bce. {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f862f0-0ddb-47e5-b208-40c19b4df1ad]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:18 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD Apr 10 13:20:18 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:18 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8" returned: 1 in 0.637s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Downloaded image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d ((None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}])) to volume 862c04a9-c90d-4694-b59b-d4a97aa23ac8 successfully. {{(pid=82554) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Temporary image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d for user 5a24be29751a462d8916d56e36b5994d is deleted. {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Marking volume 862c04a9-c90d-4694-b59b-d4a97aa23ac8 as bootable. {{(pid=82554) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Copying metadata from image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d to 862c04a9-c90d-4694-b59b-d4a97aa23ac8. {{(pid=82554) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 13:20:18 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Creating volume glance metadata for volume 862c04a9-c90d-4694-b59b-d4a97aa23ac8 backed by image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82554) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397bcdbf-f297-4088-9127-bb8affba0a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b93c6307-a114-46c2-a6ed-9d04c4afaa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:19 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Volume volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 (862c04a9-c90d-4694-b59b-d4a97aa23ac8): created successfully Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b93c6307-a114-46c2-a6ed-9d04c4afaa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (8d6f0dce-4fe4-458a-be7b-e019ec88ff00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:19 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-42a2d3a4-cf01-452d-af96-8401c6b4783c tempest-VolumesGetTest-349999875 None] Created volume successfully. Apr 10 13:20:19 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1688031003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9dba076-904a-45ad-8b4f-556453cf3864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a3edb159554c5f8aa13168b56f07bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:17Z,use_quota=True,user_id='8614e56a70024c70a7a6a7f716122bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Creating volume e9dba076-904a-45ad-8b4f-556453cf3864 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:19 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:19 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 1073741824 Apr 10 13:20:19 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (acdf91c1-641f-4543-a3c3-907497f18a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefca03c-213c-4e17-aeea-9e8574a89cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefca03c-213c-4e17-aeea-9e8574a89cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1596109626',display_name='tempest-VolumesGetTest-Volume-572350393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e339072-33ae-4506-b870-5e7a914dd475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:20Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797216b4-28cc-4782-9d36-311bb1ee5736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797216b4-28cc-4782-9d36-311bb1ee5736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e9a908-8c02-4ef6-8d00-253747accac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e9a908-8c02-4ef6-8d00-253747accac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e339072-33ae-4506-b870-5e7a914dd475', 'volume_name': 'volume-3e339072-33ae-4506-b870-5e7a914dd475', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754fca15-4d4c-4615-be4e-eea1f1714475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754fca15-4d4c-4615-be4e-eea1f1714475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19999712-a6c7-402d-9146-4b26419cfd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:19 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Volume 3e339072-33ae-4506-b870-5e7a914dd475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e339072-33ae-4506-b870-5e7a914dd475', 'volume_size': 1} Apr 10 13:20:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:20 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 1073741824" returned: 0 in 0.727s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:20 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 Apr 10 13:20:20 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:20 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864" returned: 0 in 0.479s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1596109626',display_name='tempest-VolumesGetTest-Volume-572350393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e339072-33ae-4506-b870-5e7a914dd475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ec8f0b0c494074a57ca32b78abf672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:20Z,use_quota=True,user_id='5a24be29751a462d8916d56e36b5994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Creating volume 3e339072-33ae-4506-b870-5e7a914dd475 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:20 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Attempting download of 4ccac92a-bf64-4e00-af7f-9898d1d98b1d ((None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}])) to volume e9dba076-904a-45ad-8b4f-556453cf3864. {{(pid=82554) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 13:20:20 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475 1073741824 Apr 10 13:20:20 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[537c0711-aab2-4d30-94de-3ff4af622982]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_yrcf1o0m {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:20 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_yrcf1o0m Apr 10 13:20:20 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:21 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475 1073741824" returned: 0 in 0.671s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:21 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475 Apr 10 13:20:21 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:21 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_yrcf1o0m" returned: 0 in 0.685s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_yrcf1o0m {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:21 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_yrcf1o0m Apr 10 13:20:21 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:21 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475" returned: 0 in 0.540s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19999712-a6c7-402d-9146-4b26419cfd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e339072-33ae-4506-b870-5e7a914dd475', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbcfe65-3b9e-449e-b5f1-eb3803456d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:21 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Volume volume-3e339072-33ae-4506-b870-5e7a914dd475 (3e339072-33ae-4506-b870-5e7a914dd475): created successfully Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbcfe65-3b9e-449e-b5f1-eb3803456d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Flow 'volume_create_manager' (acdf91c1-641f-4543-a3c3-907497f18a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:21 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-aebb0b9a-955d-42b2-bb91-7e9c6ffe9c13 tempest-VolumesGetTest-349999875 None] Created volume successfully. Apr 10 13:20:22 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_yrcf1o0m" returned: 1 in 0.654s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_yrcf1o0m' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f73240-94a5-40fb-a50d-7682107703be]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:22 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD Apr 10 13:20:22 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Flow 'volume_create_manager' (d975d273-37b2-4758-af04-75f4cff73b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90a700a-a468-42ba-a81c-df31012575cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90a700a-a468-42ba-a81c-df31012575cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-810679209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792570b3-cc67-4bf2-b91c-06c1fd3b04ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7a9a036d414eabbc431fd3fd5ed681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:22Z,use_quota=True,user_id='2ceb108b8a494b8d836d26cd96a97708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e35e57-15c5-442b-985c-97780f6ff07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e35e57-15c5-442b-985c-97780f6ff07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6be041-4db1-4473-97aa-81635b48e924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6be041-4db1-4473-97aa-81635b48e924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '792570b3-cc67-4bf2-b91c-06c1fd3b04ac', 'volume_name': 'volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e0f308-df91-4fa0-a081-f2d692e4777d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e0f308-df91-4fa0-a081-f2d692e4777d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b301f92a-ea29-4f46-8141-ed189e76e458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:22 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Volume 792570b3-cc67-4bf2-b91c-06c1fd3b04ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac', 'volume_size': 1} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-810679209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792570b3-cc67-4bf2-b91c-06c1fd3b04ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7a9a036d414eabbc431fd3fd5ed681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:22Z,use_quota=True,user_id='2ceb108b8a494b8d836d26cd96a97708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Creating volume 792570b3-cc67-4bf2-b91c-06c1fd3b04ac {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:22 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:22 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac 1073741824 Apr 10 13:20:22 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:22 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] 4ccac92a-bf64-4e00-af7f-9898d1d98b1d was qcow2, converting to raw {{(pid=82554) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_service.periodic_task [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82554) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:22 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 Apr 10 13:20:22 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:22 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:22 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:23 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac 1073741824" returned: 0 in 0.658s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:23 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.571s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:23 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac Apr 10 13:20:23 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-3e339072-33ae-4506-b870-5e7a914dd475-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Lock "cinder-3e339072-33ae-4506-b870-5e7a914dd475-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-quobyte-3e339072-33ae-4506-b870-5e7a914dd475" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-3e339072-33ae-4506-b870-5e7a914dd475" acquired by "delete_volume" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3632b3-098d-4a14-8ed8-6244cb8828a0]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:23 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475 Apr 10 13:20:23 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:23 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864" returned: 0 in 1.083s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_w8z5114hdevstack@QuobyteHD, size 112.00 MB, duration 1.08 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:20:23 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Converted 112.00 MB image at 103.29 MB/s Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:23 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 1G Apr 10 13:20:23 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:23 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac" returned: 0 in 0.594s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b301f92a-ea29-4f46-8141-ed189e76e458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e98f4d9-0725-40c7-83da-d315ddd8ed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:23 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Volume volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac (792570b3-cc67-4bf2-b91c-06c1fd3b04ac): created successfully Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e98f4d9-0725-40c7-83da-d315ddd8ed50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Flow 'volume_create_manager' (d975d273-37b2-4758-af04-75f4cff73b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:23 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-bc3ec845-5484-415a-9067-f87c25e19beb tempest-VolumesMetadataTest-1278389169 None] Created volume successfully. Apr 10 13:20:23 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475" returned: 0 in 0.585s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:23 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475 Apr 10 13:20:23 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:24 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 1G" returned: 0 in 0.537s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[48de4590-bc99-4f56-bc06-5b7c1b3c02c5]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:24 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 Apr 10 13:20:24 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:24 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3e339072-33ae-4506-b870-5e7a914dd475" returned: 0 in 0.495s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-3e339072-33ae-4506-b870-5e7a914dd475" released by "delete_volume" :: held 1.106s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Created reservations ['c07f55a3-3378-4093-a334-b9420c45d211', 'ab21e5b7-b941-4a39-a4a0-66999b802d58', 'a1d0f6ab-9c99-4faf-affb-01f01e7f6b24', '489e2065-b7fb-4b0c-952b-62f20785def0'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:24 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:24 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:24 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864" returned: 0 in 0.623s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:24 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 Apr 10 13:20:24 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:25 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.608s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:25 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Deleted volume successfully. Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4fd1b1a8-a697-472c-8ea7-aeb5780142aa tempest-VolumesGetTest-349999875 None] Lock "cinder-3e339072-33ae-4506-b870-5e7a914dd475-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Acquiring lock "cinder-792570b3-cc67-4bf2-b91c-06c1fd3b04ac-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Lock "cinder-792570b3-cc67-4bf2-b91c-06c1fd3b04ac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Acquiring lock "cinder-quobyte-792570b3-cc67-4bf2-b91c-06c1fd3b04ac" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Lock "cinder-quobyte-792570b3-cc67-4bf2-b91c-06c1fd3b04ac" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[03913c29-283e-4d3a-8d75-476db4205ab5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:25 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac Apr 10 13:20:25 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:25 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864" returned: 1 in 0.585s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Downloaded image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d ((None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}])) to volume e9dba076-904a-45ad-8b4f-556453cf3864 successfully. {{(pid=82554) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Temporary image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d for user 8614e56a70024c70a7a6a7f716122bce is deleted. {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Marking volume e9dba076-904a-45ad-8b4f-556453cf3864 as bootable. {{(pid=82554) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-862c04a9-c90d-4694-b59b-d4a97aa23ac8-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Copying metadata from image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d to e9dba076-904a-45ad-8b4f-556453cf3864. {{(pid=82554) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Creating volume glance metadata for volume e9dba076-904a-45ad-8b4f-556453cf3864 backed by image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82554) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Lock "cinder-862c04a9-c90d-4694-b59b-d4a97aa23ac8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Acquiring lock "cinder-quobyte-862c04a9-c90d-4694-b59b-d4a97aa23ac8" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-862c04a9-c90d-4694-b59b-d4a97aa23ac8" acquired by "delete_volume" :: waited 0.015s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21472d62-d344-4a9c-b081-5a5d19787ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9dba076-904a-45ad-8b4f-556453cf3864', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3452ba-63b9-4fb4-8042-0e6a1d9e9d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa6b9b1-3556-445c-9d0b-ea856c1d1c19]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:25 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Volume volume-e9dba076-904a-45ad-8b4f-556453cf3864 (e9dba076-904a-45ad-8b4f-556453cf3864): created successfully Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3452ba-63b9-4fb4-8042-0e6a1d9e9d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Flow 'volume_create_manager' (d20a2338-0988-4f3c-9e2c-99bf915d8bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:25 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-68cc66e9-9b11-4100-bb8d-d27487680235 tempest-VolumesImageMetadata-164438622 None] Created volume successfully. Apr 10 13:20:25 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 Apr 10 13:20:25 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:25 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac" returned: 0 in 0.564s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:25 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac Apr 10 13:20:25 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:26 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8" returned: 0 in 0.525s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:26 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 Apr 10 13:20:26 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:26 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-792570b3-cc67-4bf2-b91c-06c1fd3b04ac" returned: 0 in 0.498s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Lock "cinder-quobyte-792570b3-cc67-4bf2-b91c-06c1fd3b04ac" released by "delete_volume" :: held 1.086s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Created reservations ['3f51839e-1d9a-48da-b6f6-01f3c0991323', 'c16199c3-5d70-41fa-a839-4c403b11df1e', '7a1aa025-66f8-4a78-9edb-3dbadb2bd544', '42e07ddb-b9a2-4484-a5bb-4d926002e10b'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:26 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:26 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:26 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8" returned: 1 in 0.534s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:20:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:26 devstack sudo[87164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8 Apr 10 13:20:26 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:27 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.626s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:27 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Deleted volume successfully. Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d891956c-4cd2-4178-a6bf-642bb2d760a6 tempest-VolumesMetadataTest-1278389169 None] Lock "cinder-792570b3-cc67-4bf2-b91c-06c1fd3b04ac-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Acquiring lock "cinder-e9dba076-904a-45ad-8b4f-556453cf3864-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Lock "cinder-e9dba076-904a-45ad-8b4f-556453cf3864-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:27 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-862c04a9-c90d-4694-b59b-d4a97aa23ac8" returned: 0 in 0.495s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Lock "cinder-quobyte-862c04a9-c90d-4694-b59b-d4a97aa23ac8" released by "delete_volume" :: held 1.623s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Acquiring lock "cinder-quobyte-e9dba076-904a-45ad-8b4f-556453cf3864" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Lock "cinder-quobyte-e9dba076-904a-45ad-8b4f-556453cf3864" acquired by "delete_volume" :: waited 0.024s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Created reservations ['e4e9c9ea-e698-4c59-adf6-5aa043a4692a', 'd055d5a4-a2d0-444b-b458-01555627e871', 'cf1f0c11-d69d-4e26-8fed-17af73e5993a', 'eccf41c3-9b2c-4a3d-8b97-96058e3a7487'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0784adc8-aeca-46f6-80e2-722ad476d45f]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:27 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:27 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:27 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 Apr 10 13:20:27 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:27 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.475s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:27 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Deleted volume successfully. Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0659c308-5453-42cf-a71f-45d83a81ca39 tempest-VolumesGetTest-349999875 None] Lock "cinder-862c04a9-c90d-4694-b59b-d4a97aa23ac8-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:27 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864" returned: 0 in 0.652s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:27 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 Apr 10 13:20:27 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:28 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864" returned: 1 in 0.576s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:20:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:28 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864 Apr 10 13:20:28 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:29 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e9dba076-904a-45ad-8b4f-556453cf3864" returned: 0 in 0.571s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Lock "cinder-quobyte-e9dba076-904a-45ad-8b4f-556453cf3864" released by "delete_volume" :: held 1.842s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Created reservations ['5aacff87-6b29-4240-8ee2-b3ffd46351c7', 'c48c0710-caab-440d-9ea8-c51467312d69', 'ff576650-2327-4dbe-8b18-c8573b51baac', 'ff5c0f40-a1c8-44b2-8e4c-444a2be392ae'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:29 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:29 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:29 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.593s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:29 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Deleted volume successfully. Apr 10 13:20:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9bf34ccf-a28a-48e8-9178-66d39ea1a4f9 tempest-VolumesImageMetadata-164438622 None] Lock "cinder-e9dba076-904a-45ad-8b4f-556453cf3864-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Flow 'volume_create_manager' (8b829559-b51b-4143-924c-d778c08ca707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d27070a-d399-4346-9abd-f915cf2f9ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d27070a-d399-4346-9abd-f915cf2f9ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1778521773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4111021c-bb4f-4ab9-a183-e3e0b6a8935a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923caba4c2734154942dfcc9f34090a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:31Z,use_quota=True,user_id='91e1d931448246f0a1d884cb57db7e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd62ab6-d416-4bd6-9a16-0be65b8fe748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd62ab6-d416-4bd6-9a16-0be65b8fe748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2b8a91-51e8-4700-8c62-086f539b5dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2b8a91-51e8-4700-8c62-086f539b5dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4111021c-bb4f-4ab9-a183-e3e0b6a8935a', 'volume_name': 'volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfe18b3-1ffe-42c4-a469-1be8636c647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfe18b3-1ffe-42c4-a469-1be8636c647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe259d9-b2c0-4dbd-836a-689180d5eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:31 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Volume 4111021c-bb4f-4ab9-a183-e3e0b6a8935a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a', 'volume_size': 1} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1778521773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4111021c-bb4f-4ab9-a183-e3e0b6a8935a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923caba4c2734154942dfcc9f34090a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:31Z,use_quota=True,user_id='91e1d931448246f0a1d884cb57db7e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Creating volume 4111021c-bb4f-4ab9-a183-e3e0b6a8935a {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:31 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:31 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a 1073741824 Apr 10 13:20:31 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:31 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a 1073741824" returned: 0 in 0.612s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:31 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a Apr 10 13:20:31 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (0f4c6dc9-d02a-4366-88ca-66daca64586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bad692-aa8f-47b1-b684-6f971cb92a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bad692-aa8f-47b1-b684-6f971cb92a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1242918778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b1179d-b964-49ec-ad37-e95fa0814e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:32Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12236db3-1214-41d7-941b-b0c18931837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12236db3-1214-41d7-941b-b0c18931837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c193510-c82a-4a55-be95-1e041b65276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c193510-c82a-4a55-be95-1e041b65276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b1179d-b964-49ec-ad37-e95fa0814e0e', 'volume_name': 'volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c45561-9a46-4fdf-81ee-a88dc02413e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c45561-9a46-4fdf-81ee-a88dc02413e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be991a5-ddf4-42ae-88f7-42a854dc64eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume d7b1179d-b964-49ec-ad37-e95fa0814e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e', 'volume_size': 1} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Flow 'volume_create_manager' (4d53b90f-d09f-41c9-95c6-ccca84cba282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3fc335-f64f-4c5b-953b-6291b297226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3fc335-f64f-4c5b-953b-6291b297226b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-223578239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d201e558-5d94-4450-b8a9-33dbb8b18057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ea71de181245e7bc804a316844255c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:32Z,use_quota=True,user_id='9c5c13f8c83f4c8aba13276067014d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a052ea7-89d3-4baa-8700-16cde0d2c46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a052ea7-89d3-4baa-8700-16cde0d2c46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3237d63-d89a-49de-a51e-c43afa058fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3237d63-d89a-49de-a51e-c43afa058fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd201e558-5d94-4450-b8a9-33dbb8b18057', 'volume_name': 'volume-d201e558-5d94-4450-b8a9-33dbb8b18057', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4072aa36-14b5-4f24-8f2a-44b7dde3593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4072aa36-14b5-4f24-8f2a-44b7dde3593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f832787-63ca-4e0f-b375-f9cc6bf990fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Volume d201e558-5d94-4450-b8a9-33dbb8b18057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d201e558-5d94-4450-b8a9-33dbb8b18057', 'volume_size': 1} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:32 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a" returned: 0 in 0.547s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.213s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1242918778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b1179d-b964-49ec-ad37-e95fa0814e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:32Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Creating volume d7b1179d-b964-49ec-ad37-e95fa0814e0e {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:32 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe259d9-b2c0-4dbd-836a-689180d5eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e235f73-6ed4-42ea-b002-34159b79e919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:32 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e 1073741824 Apr 10 13:20:32 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:32 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Volume volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a (4111021c-bb4f-4ab9-a183-e3e0b6a8935a): created successfully Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e235f73-6ed4-42ea-b002-34159b79e919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Flow 'volume_create_manager' (8b829559-b51b-4143-924c-d778c08ca707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:32 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-e6491765-fc15-492e-8cc8-b34826b3eba4 tempest-VolumesTransfersTest-1520958763 None] Created volume successfully. Apr 10 13:20:33 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e 1073741824" returned: 0 in 0.533s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:33 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e Apr 10 13:20:33 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:33 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e" returned: 0 in 0.490s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-223578239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d201e558-5d94-4450-b8a9-33dbb8b18057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ea71de181245e7bc804a316844255c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:32Z,use_quota=True,user_id='9c5c13f8c83f4c8aba13276067014d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Creating volume d201e558-5d94-4450-b8a9-33dbb8b18057 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:33 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be991a5-ddf4-42ae-88f7-42a854dc64eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:33 devstack sudo[87210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 1073741824 Apr 10 13:20:33 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f60dd6d-0431-4e46-932d-0e024007a49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:33 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e (d7b1179d-b964-49ec-ad37-e95fa0814e0e): created successfully Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f60dd6d-0431-4e46-932d-0e024007a49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (0f4c6dc9-d02a-4366-88ca-66daca64586b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:33 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-5d2def10-cab5-4142-8a21-ae19959d2750 tempest-CreateVolumesFromSnapshotTest-72882361 None] Created volume successfully. Apr 10 13:20:33 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1b34f124-4093-4dcb-821f-7e39917bb908 tempest-VolumesTransfersTest-365372275 None] Transfer volume completed successfully. Apr 10 13:20:34 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 1073741824" returned: 0 in 0.524s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:34 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 Apr 10 13:20:34 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:34 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057" returned: 0 in 0.533s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.222s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f832787-63ca-4e0f-b375-f9cc6bf990fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d201e558-5d94-4450-b8a9-33dbb8b18057', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0d3264-ed9c-44ad-b248-ab0b10e88e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Creating offline snapshot 4834f0c9-5ee1-49c4-83ff-69bdf766394a of volume d7b1179d-b964-49ec-ad37-e95fa0814e0e {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d4191f-d587-4f01-bb0d-cc1805e441c9]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:34 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Volume volume-d201e558-5d94-4450-b8a9-33dbb8b18057 (d201e558-5d94-4450-b8a9-33dbb8b18057): created successfully Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0d3264-ed9c-44ad-b248-ab0b10e88e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Flow 'volume_create_manager' (4d53b90f-d09f-41c9-95c6-ccca84cba282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:34 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-aa9b8320-31b5-44df-ad4c-fce0414bde5b tempest-SnapshotMetadataTestJSON-76926723 None] Created volume successfully. Apr 10 13:20:34 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Acquiring lock "cinder-4111021c-bb4f-4ab9-a183-e3e0b6a8935a-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Lock "cinder-4111021c-bb4f-4ab9-a183-e3e0b6a8935a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:34 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Acquiring lock "cinder-quobyte-4111021c-bb4f-4ab9-a183-e3e0b6a8935a" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Lock "cinder-quobyte-4111021c-bb4f-4ab9-a183-e3e0b6a8935a" acquired by "delete_volume" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6b5200-a7c3-4ded-88c6-b11cf745bc69]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:34 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a Apr 10 13:20:34 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:35 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e" returned: 0 in 0.622s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:35 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a 1G Apr 10 13:20:35 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:35 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a" returned: 0 in 0.645s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:35 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a Apr 10 13:20:35 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:35 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a 1G" returned: 0 in 0.616s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:35 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a Apr 10 13:20:35 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:36 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4111021c-bb4f-4ab9-a183-e3e0b6a8935a" returned: 0 in 0.675s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Lock "cinder-quobyte-4111021c-bb4f-4ab9-a183-e3e0b6a8935a" released by "delete_volume" :: held 1.343s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Created reservations ['a24f60e3-23f2-4bd4-b03c-74644d8d803b', 'eac33aa3-f1f1-44ed-96b1-0e5459f8c4c8', '1304cf35-0f7e-4c27-a92c-e04b794b4270', 'f40b1878-8e09-432b-930d-53c25a517bf3'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:36 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:36 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:36 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a" returned: 0 in 0.540s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:36 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a is being set with open permissions: ugo+rw Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:36 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a Apr 10 13:20:36 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:36 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.505s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:36 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Deleted volume successfully. Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b5b476ac-e17b-4435-b591-45b5c6e37ccf tempest-VolumesTransfersTest-782018805 None] Lock "cinder-4111021c-bb4f-4ab9-a183-e3e0b6a8935a-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:36 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a" returned: 0 in 0.529s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:37 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.info Apr 10 13:20:37 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Flow 'volume_create_manager' (6c8e22ab-84df-409b-a386-cf2bc84b9444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45065913-dc9b-4023-933f-714bacdbfc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45065913-dc9b-4023-933f-714bacdbfc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1061651684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1548a696-82e3-4f37-8772-b52df696d8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923caba4c2734154942dfcc9f34090a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:37Z,use_quota=True,user_id='91e1d931448246f0a1d884cb57db7e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad964be9-e38c-4ce2-9340-458a53b88dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad964be9-e38c-4ce2-9340-458a53b88dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f31c84-564d-4942-8f57-b07f13f8a5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f31c84-564d-4942-8f57-b07f13f8a5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1548a696-82e3-4f37-8772-b52df696d8f1', 'volume_name': 'volume-1548a696-82e3-4f37-8772-b52df696d8f1', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c9fd76-0872-4e4d-a23e-258c4bf751d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c9fd76-0872-4e4d-a23e-258c4bf751d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ae2be7-3547-4c48-b072-af1b9f39875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:37 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Volume 1548a696-82e3-4f37-8772-b52df696d8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1548a696-82e3-4f37-8772-b52df696d8f1', 'volume_size': 1} Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:37 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.info" returned: 0 in 0.531s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:37 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.info is being set with open permissions: ugo+rw Apr 10 13:20:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:37 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.info Apr 10 13:20:37 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:38 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.info" returned: 0 in 0.476s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.391s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.200s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Creating offline snapshot 7eb896a6-ada4-4a1b-a6eb-e31f23874b88 of volume d201e558-5d94-4450-b8a9-33dbb8b18057 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:20:38 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-f66e2c92-26c4-40ca-b5bc-9b950cb66bc7 tempest-CreateVolumesFromSnapshotTest-72882361 None] Create snapshot completed successfully Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b336f9c7-0bc1-4e38-bf7b-21580c7b55b4]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:38 devstack sudo[87291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 Apr 10 13:20:38 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:38 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057" returned: 0 in 0.565s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:38 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 1G Apr 10 13:20:38 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (bb63d2aa-085f-4aca-8623-50845a4f741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8340e3-4384-4693-a90e-89f1869c85a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8340e3-4384-4693-a90e-89f1869c85a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-688183177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77ea128-c13c-4935-9a03-2b8fcbca53eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:39Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bce8ee4-946a-4f81-8b69-fc27e8f6e74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bce8ee4-946a-4f81-8b69-fc27e8f6e74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b117c2-b310-4056-ad79-6a61a72a962f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b117c2-b310-4056-ad79-6a61a72a962f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77ea128-c13c-4935-9a03-2b8fcbca53eb', 'volume_name': 'volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bea0aa-e87e-441d-9197-657d71b4c31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bea0aa-e87e-441d-9197-657d71b4c31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a09714-16d9-4777-8c40-23a6af2a7860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:38 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume d77ea128-c13c-4935-9a03-2b8fcbca53eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb', 'volume_size': 1} Apr 10 13:20:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (31299520-281c-4981-8f76-ca8de1ae9b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cfefb0-dd83-4d0a-a4d2-bf92b73f0bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cfefb0-dd83-4d0a-a4d2-bf92b73f0bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1744460170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3006b0ac-b164-4926-b087-49cb9c7d595d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:39Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14051aff-cbc0-4ac7-89f2-afb5ceff5bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14051aff-cbc0-4ac7-89f2-afb5ceff5bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a960f5-3c71-4456-bddb-3315ab35b98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a960f5-3c71-4456-bddb-3315ab35b98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3006b0ac-b164-4926-b087-49cb9c7d595d', 'volume_name': 'volume-3006b0ac-b164-4926-b087-49cb9c7d595d', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834c6317-cafb-41c7-9516-5be9f9a048c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834c6317-cafb-41c7-9516-5be9f9a048c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710885da-edf9-4b1a-867c-a711d5ff42c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume 3006b0ac-b164-4926-b087-49cb9c7d595d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3006b0ac-b164-4926-b087-49cb9c7d595d', 'volume_size': 1} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:39 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 1G" returned: 0 in 0.698s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d201e558-5d94-4450-b8a9-33dbb8b18057 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:39 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d201e558-5d94-4450-b8a9-33dbb8b18057 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 Apr 10 13:20:39 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (f4462f68-51f1-4cad-9fe0-01a7535b9766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b829fc-48d3-43a0-9a28-f0b95395957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b829fc-48d3-43a0-9a28-f0b95395957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1326190408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31f8927-1ddf-44c4-b3f2-880ea05f258c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:39Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4099ea5-1fbf-4da5-b056-98196e78f3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4099ea5-1fbf-4da5-b056-98196e78f3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8851f035-7886-485e-8277-895f3261aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8851f035-7886-485e-8277-895f3261aafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31f8927-1ddf-44c4-b3f2-880ea05f258c', 'volume_name': 'volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a2778f-aaa6-4da4-84e9-815fbbfc1bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a2778f-aaa6-4da4-84e9-815fbbfc1bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d7c0d9-92fc-4c2f-8db2-9622cf4cc665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume b31f8927-1ddf-44c4-b3f2-880ea05f258c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c', 'volume_size': 1} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (139745ff-7f60-4bb7-983a-d325ae84db44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac926d82-1d6a-49b5-818e-c9eccfa81fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac926d82-1d6a-49b5-818e-c9eccfa81fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-792712169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4151caaf-a09a-437a-a0cb-0084e3958c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:40Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd47c5d-078e-4689-9184-67f16b4c3aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd47c5d-078e-4689-9184-67f16b4c3aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ae97ce-6678-4bed-b932-fc81748c2be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ae97ce-6678-4bed-b932-fc81748c2be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4151caaf-a09a-437a-a0cb-0084e3958c72', 'volume_name': 'volume-4151caaf-a09a-437a-a0cb-0084e3958c72', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7236dcac-2176-4dd0-8b17-a84ca69f16a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7236dcac-2176-4dd0-8b17-a84ca69f16a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead88f1b-126c-421b-b8c6-e3a19539b349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume 4151caaf-a09a-437a-a0cb-0084e3958c72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4151caaf-a09a-437a-a0cb-0084e3958c72', 'volume_size': 1} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (2ee0e11b-1ce7-4fb9-8043-169433265abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f340618c-26cd-420e-8029-93d2615ead2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f340618c-26cd-420e-8029-93d2615ead2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950890826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4e1e20-366e-4775-9fdf-74e9518858d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:40Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac46c9b9-ae6a-4718-ba79-bf3ec675198c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac46c9b9-ae6a-4718-ba79-bf3ec675198c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1691ae8-a8a9-48cc-85c2-21a2e1c70eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1691ae8-a8a9-48cc-85c2-21a2e1c70eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4e1e20-366e-4775-9fdf-74e9518858d5', 'volume_name': 'volume-2f4e1e20-366e-4775-9fdf-74e9518858d5', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdb3d46-1e53-480b-9a31-f1759fe392f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdb3d46-1e53-480b-9a31-f1759fe392f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346f82b5-4e9e-4662-8632-3550b74c6076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume 2f4e1e20-366e-4775-9fdf-74e9518858d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4e1e20-366e-4775-9fdf-74e9518858d5', 'volume_size': 1} Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:39 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d201e558-5d94-4450-b8a9-33dbb8b18057 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88" returned: 0 in 0.611s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:39 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 is being set with open permissions: ugo+rw Apr 10 13:20:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:39 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 Apr 10 13:20:39 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:40 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88" returned: 0 in 0.416s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:40 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.info Apr 10 13:20:40 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:40 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.info" returned: 0 in 0.420s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:40 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.info is being set with open permissions: ugo+rw Apr 10 13:20:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:40 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.info Apr 10 13:20:40 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:41 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.info" returned: 0 in 0.438s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.247s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.892s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1061651684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1548a696-82e3-4f37-8772-b52df696d8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923caba4c2734154942dfcc9f34090a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:37Z,use_quota=True,user_id='91e1d931448246f0a1d884cb57db7e90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Creating volume 1548a696-82e3-4f37-8772-b52df696d8f1 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:41 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9f894f9d-3c9c-4248-bc18-351af81aa407 tempest-SnapshotMetadataTestJSON-76926723 None] Create snapshot completed successfully Apr 10 13:20:41 devstack sudo[87317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1 1073741824 Apr 10 13:20:41 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:41 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1 1073741824" returned: 0 in 0.534s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:41 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1 Apr 10 13:20:41 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:42 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1" returned: 0 in 0.601s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.497s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-688183177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77ea128-c13c-4935-9a03-2b8fcbca53eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:39Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Creating volume d77ea128-c13c-4935-9a03-2b8fcbca53eb {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:42 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ae2be7-3547-4c48-b072-af1b9f39875c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1548a696-82e3-4f37-8772-b52df696d8f1', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff3b0e6-4dfd-46ad-ba9b-7efd8e25ab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:42 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Volume volume-1548a696-82e3-4f37-8772-b52df696d8f1 (1548a696-82e3-4f37-8772-b52df696d8f1): created successfully Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff3b0e6-4dfd-46ad-ba9b-7efd8e25ab55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:42 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb 1073741824 Apr 10 13:20:42 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Flow 'volume_create_manager' (6c8e22ab-84df-409b-a386-cf2bc84b9444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:42 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4eac3519-08e9-453a-ba30-20558b775bc9 tempest-VolumesTransfersTest-1520958763 None] Created volume successfully. Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Acquiring lock "cinder-7eb896a6-ada4-4a1b-a6eb-e31f23874b88-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Lock "cinder-7eb896a6-ada4-4a1b-a6eb-e31f23874b88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Acquiring lock "cinder-quobyte-d201e558-5d94-4450-b8a9-33dbb8b18057" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Lock "cinder-quobyte-d201e558-5d94-4450-b8a9-33dbb8b18057" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Acquiring lock "cinder-quobyte-7eb896a6-ada4-4a1b-a6eb-e31f23874b88" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Lock "cinder-quobyte-7eb896a6-ada4-4a1b-a6eb-e31f23874b88" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Deleting offline snapshot 7eb896a6-ada4-4a1b-a6eb-e31f23874b88 of volume d201e558-5d94-4450-b8a9-33dbb8b18057 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] snapshot_file for this snap is: volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7d005a-d653-4aa3-9ace-2154905fea07]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:42 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 Apr 10 13:20:42 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Acquiring lock "cinder-1548a696-82e3-4f37-8772-b52df696d8f1-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Lock "cinder-1548a696-82e3-4f37-8772-b52df696d8f1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Acquiring lock "cinder-quobyte-1548a696-82e3-4f37-8772-b52df696d8f1" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Lock "cinder-quobyte-1548a696-82e3-4f37-8772-b52df696d8f1" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[809a5779-855b-4b42-8068-dd5fd094fa62]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:43 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1 Apr 10 13:20:43 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:43 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb 1073741824" returned: 0 in 0.703s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:43 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb Apr 10 13:20:43 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:43 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88" returned: 0 in 0.734s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d201e558-5d94-4450-b8a9-33dbb8b18057(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7556b2-15eb-4a27-bf58-056ff11d7115]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:43 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 Apr 10 13:20:43 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:43 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1" returned: 0 in 0.618s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:43 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1 Apr 10 13:20:43 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:43 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb" returned: 0 in 0.511s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.496s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1744460170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3006b0ac-b164-4926-b087-49cb9c7d595d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:39Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Creating volume 3006b0ac-b164-4926-b087-49cb9c7d595d {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:43 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a09714-16d9-4777-8c40-23a6af2a7860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8a696e-5e08-477d-a2f9-845cca296f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:43 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb (d77ea128-c13c-4935-9a03-2b8fcbca53eb): created successfully Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8a696e-5e08-477d-a2f9-845cca296f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (bb63d2aa-085f-4aca-8623-50845a4f741d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:43 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a594306f-5bdb-4e26-b1a8-346425a2af0d tempest-CreateVolumesFromSnapshotTest-72882361 None] Created volume successfully. Apr 10 13:20:43 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d 1073741824 Apr 10 13:20:43 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:44 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057" returned: 0 in 0.663s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:44 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 Apr 10 13:20:44 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:44 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1548a696-82e3-4f37-8772-b52df696d8f1" returned: 0 in 0.568s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Lock "cinder-quobyte-1548a696-82e3-4f37-8772-b52df696d8f1" released by "delete_volume" :: held 1.211s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Created reservations ['4062697d-f2e4-4b61-9918-f133432f2c6f', '4417b298-756e-4be4-8d95-1351cf40ea86', 'a78366d4-1784-47c1-830e-e4bb80203a92', '68912615-fc4d-4a6f-a8e5-26e022cb7ce2'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:44 devstack sudo[87360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:44 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:44 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d 1073741824" returned: 0 in 0.659s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:44 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d Apr 10 13:20:44 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:44 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88" returned: 0 in 0.529s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:44 devstack sudo[87380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88 Apr 10 13:20:44 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:44 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.481s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:44 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Deleted volume successfully. Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-11b25d02-7b39-416e-8df9-9624cb79e85b tempest-VolumesTransfersTest-782018805 None] Lock "cinder-1548a696-82e3-4f37-8772-b52df696d8f1-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:44 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d" returned: 0 in 0.536s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.366s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1326190408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31f8927-1ddf-44c4-b3f2-880ea05f258c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:39Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Creating volume b31f8927-1ddf-44c4-b3f2-880ea05f258c {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:44 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710885da-edf9-4b1a-867c-a711d5ff42c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3006b0ac-b164-4926-b087-49cb9c7d595d', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:44 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c 1073741824 Apr 10 13:20:44 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a968e4-f7e1-48f9-b6ca-27e7010b8734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:45 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume volume-3006b0ac-b164-4926-b087-49cb9c7d595d (3006b0ac-b164-4926-b087-49cb9c7d595d): created successfully Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a968e4-f7e1-48f9-b6ca-27e7010b8734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (31299520-281c-4981-8f76-ca8de1ae9b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:45 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a3c105b7-d644-4438-8970-7f8069fd386a tempest-CreateVolumesFromSnapshotTest-72882361 None] Created volume successfully. Apr 10 13:20:45 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057.7eb896a6-ada4-4a1b-a6eb-e31f23874b88" returned: 0 in 0.513s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Lock "cinder-quobyte-7eb896a6-ada4-4a1b-a6eb-e31f23874b88" released by "_delete_snapshot" :: held 2.521s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Lock "cinder-quobyte-d201e558-5d94-4450-b8a9-33dbb8b18057" released by "delete_snapshot" :: held 2.541s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Created reservations ['ef8d1d10-7131-4555-8e3c-de5b839a06d2', 'e65f94a0-4473-46f6-b3cd-ab115aadcf29', '2f7a0359-776b-4f9a-9989-436253e5636b', '8063256b-716c-4475-8988-4589d07f0549'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:45 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Delete snapshot completed successfully. Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9d69f5ce-d807-4814-8df6-99a1e6999f80 tempest-SnapshotMetadataTestJSON-76926723 None] Lock "cinder-7eb896a6-ada4-4a1b-a6eb-e31f23874b88-delete_snapshot" released by "delete_snapshot" :: held 2.650s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:45 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c 1073741824" returned: 0 in 0.494s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:45 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c Apr 10 13:20:45 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:45 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c" returned: 0 in 0.442s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.191s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-792712169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4151caaf-a09a-437a-a0cb-0084e3958c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:40Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Creating volume 4151caaf-a09a-437a-a0cb-0084e3958c72 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:45 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Acquiring lock "cinder-d201e558-5d94-4450-b8a9-33dbb8b18057-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:45 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72 1073741824 Apr 10 13:20:45 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d7c0d9-92fc-4c2f-8db2-9622cf4cc665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91216311-a776-4c21-bb33-e99c43a2ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:45 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c (b31f8927-1ddf-44c4-b3f2-880ea05f258c): created successfully Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91216311-a776-4c21-bb33-e99c43a2ffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (f4462f68-51f1-4cad-9fe0-01a7535b9766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Lock "cinder-d201e558-5d94-4450-b8a9-33dbb8b18057-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:46 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a19732d2-0270-40af-990d-43bcc96a51ee tempest-CreateVolumesFromSnapshotTest-72882361 None] Created volume successfully. Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Acquiring lock "cinder-quobyte-d201e558-5d94-4450-b8a9-33dbb8b18057" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Lock "cinder-quobyte-d201e558-5d94-4450-b8a9-33dbb8b18057" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a177c85-f943-4c20-8378-26cdd1ae4905]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:46 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 Apr 10 13:20:46 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:46 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72 1073741824" returned: 0 in 0.716s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:46 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72 Apr 10 13:20:46 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:46 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057" returned: 0 in 0.665s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:46 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057 Apr 10 13:20:46 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:47 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72" returned: 0 in 0.511s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.269s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950890826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4e1e20-366e-4775-9fdf-74e9518858d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12adf9ed5a4d425f9f23065a0af6aa40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:40Z,use_quota=True,user_id='46644ef53193433aa874cdd92a5df458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Creating volume 2f4e1e20-366e-4775-9fdf-74e9518858d5 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:47 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead88f1b-126c-421b-b8c6-e3a19539b349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4151caaf-a09a-437a-a0cb-0084e3958c72', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefa676b-5f8b-4b0b-b89d-87f7f7362ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:47 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5 1073741824 Apr 10 13:20:47 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:47 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume volume-4151caaf-a09a-437a-a0cb-0084e3958c72 (4151caaf-a09a-437a-a0cb-0084e3958c72): created successfully Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefa676b-5f8b-4b0b-b89d-87f7f7362ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (139745ff-7f60-4bb7-983a-d325ae84db44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:47 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-5559e998-b0d2-4611-907f-35a000416759 tempest-CreateVolumesFromSnapshotTest-72882361 None] Created volume successfully. Apr 10 13:20:47 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d201e558-5d94-4450-b8a9-33dbb8b18057" returned: 0 in 0.548s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Lock "cinder-quobyte-d201e558-5d94-4450-b8a9-33dbb8b18057" released by "delete_volume" :: held 1.251s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Created reservations ['3e272cd4-8e1f-4bca-a1d5-c15e2536aa6f', 'd7560cf8-147d-477f-886e-352403f5abd5', '4f4972ff-b4b5-4a0f-90b2-b86f5c5b0c34', '2f63b5df-db3b-4864-b0f3-6c4823e1e42d'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:47 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:47 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:47 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5 1073741824" returned: 0 in 0.686s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:47 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5 Apr 10 13:20:47 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:47 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.542s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:47 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Deleted volume successfully. Apr 10 13:20:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bbb5b86-fad0-41d2-8ab8-52bf920a93ed tempest-SnapshotMetadataTestJSON-76926723 None] Lock "cinder-d201e558-5d94-4450-b8a9-33dbb8b18057-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:48 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5" returned: 0 in 0.479s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (346f82b5-4e9e-4662-8632-3550b74c6076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4e1e20-366e-4775-9fdf-74e9518858d5', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9150a3eb-a4f6-4fe4-b608-a3ccf7aa987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:48 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Volume volume-2f4e1e20-366e-4775-9fdf-74e9518858d5 (2f4e1e20-366e-4775-9fdf-74e9518858d5): created successfully Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9150a3eb-a4f6-4fe4-b608-a3ccf7aa987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Flow 'volume_create_manager' (2ee0e11b-1ce7-4fb9-8043-169433265abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:48 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3440bad8-bb7e-4340-9e21-727a7c1b83dd tempest-CreateVolumesFromSnapshotTest-72882361 None] Created volume successfully. Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-2f4e1e20-366e-4775-9fdf-74e9518858d5-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-2f4e1e20-366e-4775-9fdf-74e9518858d5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-quobyte-2f4e1e20-366e-4775-9fdf-74e9518858d5" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-2f4e1e20-366e-4775-9fdf-74e9518858d5" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c615f184-70f3-451b-abc1-eb9ef80d7d22]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:48 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5 Apr 10 13:20:48 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:49 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5" returned: 0 in 0.739s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:49 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5 Apr 10 13:20:49 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Flow 'volume_create_manager' (824320ea-c42a-495a-868c-6939ecc61846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0df8c8f-734f-44cb-ad28-dc823fb5b919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0df8c8f-734f-44cb-ad28-dc823fb5b919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-424727090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d59ec3-85b4-4751-b819-bd5caaea6e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf01e278df744119037ad647e61e36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:50Z,use_quota=True,user_id='083c1317620c4627b202a4df4ea525ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37afbf9b-dd78-4637-a206-a926d88dc91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37afbf9b-dd78-4637-a206-a926d88dc91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b606e83-24e6-4d23-8ba5-03fdf20e5dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b606e83-24e6-4d23-8ba5-03fdf20e5dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d59ec3-85b4-4751-b819-bd5caaea6e0d', 'volume_name': 'volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0397d971-07f4-41c3-ab68-f190541f5032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0397d971-07f4-41c3-ab68-f190541f5032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977e95ea-cccd-44f4-b004-7dbac46a3d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:50 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Volume e7d59ec3-85b4-4751-b819-bd5caaea6e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d', 'volume_size': 1} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-424727090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d59ec3-85b4-4751-b819-bd5caaea6e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf01e278df744119037ad647e61e36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:50Z,use_quota=True,user_id='083c1317620c4627b202a4df4ea525ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Creating volume e7d59ec3-85b4-4751-b819-bd5caaea6e0d {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:50 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:50 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2f4e1e20-366e-4775-9fdf-74e9518858d5" returned: 0 in 0.940s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-2f4e1e20-366e-4775-9fdf-74e9518858d5" released by "delete_volume" :: held 1.709s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:50 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d 1073741824 Apr 10 13:20:50 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Created reservations ['737f9926-9aa0-43a7-b9e7-af728806d7d6', 'ad764381-ffa0-4367-a042-430d43d38811', 'c48e181e-0a05-4b2e-9463-cadf0dd13333', '2628e2db-3555-4573-bb07-46a4b23232d5'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:50 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:50 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-4151caaf-a09a-437a-a0cb-0084e3958c72-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-4151caaf-a09a-437a-a0cb-0084e3958c72-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-quobyte-4151caaf-a09a-437a-a0cb-0084e3958c72" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-4151caaf-a09a-437a-a0cb-0084e3958c72" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e239232a-0393-490e-b70e-5421ea9e82b7]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Flow 'volume_create_manager' (092a6f68-5e82-4756-8cb3-8cf6370d5d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32787bd9-57bd-4035-9c12-537b3cd42c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32787bd9-57bd-4035-9c12-537b3cd42c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1538451501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf425e8-ef00-4b6a-9d12-89ec2d9e9535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0047db434cdc4cc49ff3a27fde6c22ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:51Z,use_quota=True,user_id='34cdbce16c3a47fdb9fa62328e0797b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1f0e4c-80fa-4283-b04e-62fff1181f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1f0e4c-80fa-4283-b04e-62fff1181f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f78e465-ea28-4f03-ade9-efe0c58dbd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.image.glance [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Creating Keystone auth plugin from conf {{(pid=82554) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 13:20:51 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72 Apr 10 13:20:51 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:51 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.771s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:51 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Deleted volume successfully. Apr 10 13:20:51 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9edac1b7-65ca-49da-8edd-1a2b3e02daca tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-2f4e1e20-366e-4775-9fdf-74e9518858d5-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d 1073741824" returned: 0 in 0.915s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:51 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d Apr 10 13:20:51 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f78e465-ea28-4f03-ade9-efe0c58dbd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3cf425e8-ef00-4b6a-9d12-89ec2d9e9535', 'volume_name': 'volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57b86b3-4b61-44da-8657-542ed7f1eeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57b86b3-4b61-44da-8657-542ed7f1eeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435a2a8b-3cca-4045-b41f-fa46054d26b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:51 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Volume 3cf425e8-ef00-4b6a-9d12-89ec2d9e9535: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Trying to clone 3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 from image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]). {{(pid=82554) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 13:20:51 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Image download 20.69 MB at 20.69 MB/s Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d42b3b-02cd-4d7f-9cd8-1ee78ed98721]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:51 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD Apr 10 13:20:51 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:51 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72" returned: 0 in 0.911s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:52 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72 Apr 10 13:20:52 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (29b2e0d0-d165-4a59-a2b2-75aee6a70b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c935b05f-2a6f-4bd2-83ad-7fb5fede1031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c935b05f-2a6f-4bd2-83ad-7fb5fede1031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1090179986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0297dd-1ade-42d3-ba34-9b07fb18d1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:52Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9df3cb-df1c-4b2a-a751-00da8dbbef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9df3cb-df1c-4b2a-a751-00da8dbbef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22da65aa-7220-4533-ae09-dc86ef005de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22da65aa-7220-4533-ae09-dc86ef005de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a0297dd-1ade-42d3-ba34-9b07fb18d1aa', 'volume_name': 'volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3b05c2-518d-4cd2-801b-d5289ef425e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3b05c2-518d-4cd2-801b-d5289ef425e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209a1f18-36f2-4816-9cdf-1250db4deccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:52 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Volume 4a0297dd-1ade-42d3-ba34-9b07fb18d1aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa', 'volume_size': 1} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:52 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d" returned: 0 in 0.869s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1090179986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0297dd-1ade-42d3-ba34-9b07fb18d1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:52Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Creating volume 4a0297dd-1ade-42d3-ba34-9b07fb18d1aa {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:52 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977e95ea-cccd-44f4-b004-7dbac46a3d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d9ce0a-afee-49ae-b0cb-80e78791f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:52 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa 1073741824 Apr 10 13:20:52 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:52 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Volume volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d (e7d59ec3-85b4-4751-b819-bd5caaea6e0d): created successfully Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d9ce0a-afee-49ae-b0cb-80e78791f100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Flow 'volume_create_manager' (824320ea-c42a-495a-868c-6939ecc61846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:52 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8f3f8ff2-e2d5-4523-b5d2-be0342fb68ba tempest-VolumesTransfersV355Test-614658687 None] Created volume successfully. Apr 10 13:20:52 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD" returned: 0 in 0.671s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Temporary image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d is fetched for user 34cdbce16c3a47fdb9fa62328e0797b3. {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea329c6-8bba-4e72-9b8a-b7bc8b7278fa]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:52 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD Apr 10 13:20:52 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:52 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4151caaf-a09a-437a-a0cb-0084e3958c72" returned: 0 in 0.641s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-4151caaf-a09a-437a-a0cb-0084e3958c72" released by "delete_volume" :: held 1.615s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Created reservations ['fec0f4e4-81a5-44c1-b148-b9bd03672f94', 'facacfaf-f080-476f-b1ad-c4a4173e8800', 'cf4d525f-786c-4c63-a343-f48cf671b76b', '171d0493-ea01-4054-bd76-acf94bf0942e'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:52 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:52 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:52 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa 1073741824" returned: 0 in 0.679s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:52 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa Apr 10 13:20:52 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:52 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD" returned: 0 in 0.588s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:53 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b445f4f3-7d87-4b12-ae26-fce24b0b1de9 tempest-VolumesTransfersV355Test-829951100 None] Transfer volume completed successfully. Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-b31f8927-1ddf-44c4-b3f2-880ea05f258c-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-b31f8927-1ddf-44c4-b3f2-880ea05f258c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-quobyte-b31f8927-1ddf-44c4-b3f2-880ea05f258c" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-b31f8927-1ddf-44c4-b3f2-880ea05f258c" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b974a0e3-3037-4278-96b8-7fd68749f613]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:53 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c Apr 10 13:20:53 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:53 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.613s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:53 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa" returned: 0 in 0.530s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:53 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Deleted volume successfully. Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.409s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1538451501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf425e8-ef00-4b6a-9d12-89ec2d9e9535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0047db434cdc4cc49ff3a27fde6c22ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:51Z,use_quota=True,user_id='34cdbce16c3a47fdb9fa62328e0797b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Creating volume 3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:53 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209a1f18-36f2-4816-9cdf-1250db4deccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:53 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 1073741824 Apr 10 13:20:53 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70045cb3-2441-4344-83d9-0740f89a9f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:53 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Volume volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa (4a0297dd-1ade-42d3-ba34-9b07fb18d1aa): created successfully Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70045cb3-2441-4344-83d9-0740f89a9f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (29b2e0d0-d165-4a59-a2b2-75aee6a70b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6dc7257a-3000-4acc-af1d-cd45ce020473 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-4151caaf-a09a-437a-a0cb-0084e3958c72-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:53 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6c1fa26e-dad4-45ae-90ec-5b1f27910012 tempest-VolumesActionsTest-816741818 None] Created volume successfully. Apr 10 13:20:53 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c" returned: 0 in 0.626s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:53 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c Apr 10 13:20:53 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Acquiring lock "cinder-e7d59ec3-85b4-4751-b819-bd5caaea6e0d-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Lock "cinder-e7d59ec3-85b4-4751-b819-bd5caaea6e0d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:53 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Acquiring lock "cinder-quobyte-e7d59ec3-85b4-4751-b819-bd5caaea6e0d" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 1073741824" returned: 0 in 0.556s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Lock "cinder-quobyte-e7d59ec3-85b4-4751-b819-bd5caaea6e0d" acquired by "delete_volume" :: waited 0.020s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a13e746-88ed-4f78-8cac-d752acbec7e5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:54 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 Apr 10 13:20:54 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:54 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d Apr 10 13:20:54 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c5540fef-a322-429b-b9c1-80255f6030ce tempest-VolumesActionsTest-816741818 None] Acquiring lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa" by "attach_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c5540fef-a322-429b-b9c1-80255f6030ce tempest-VolumesActionsTest-816741818 None] Lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa" acquired by "attach_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:54 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c5540fef-a322-429b-b9c1-80255f6030ce tempest-VolumesActionsTest-816741818 None] Attaching volume 4a0297dd-1ade-42d3-ba34-9b07fb18d1aa to instance 861356ec-b151-4d74-853d-97faca84bc44 at mountpoint /dev/vdb on host None. Apr 10 13:20:54 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c5540fef-a322-429b-b9c1-80255f6030ce tempest-VolumesActionsTest-816741818 None] Attach volume completed successfully. Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c5540fef-a322-429b-b9c1-80255f6030ce tempest-VolumesActionsTest-816741818 None] Lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa" released by "attach_volume" :: held 0.118s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:54 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b31f8927-1ddf-44c4-b3f2-880ea05f258c" returned: 0 in 0.586s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-b31f8927-1ddf-44c4-b3f2-880ea05f258c" released by "delete_volume" :: held 1.294s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Created reservations ['7265c929-4163-4b51-a9c2-b6aed112d4b2', '556498ca-15f8-4836-9145-7110bb5ec776', 'cc0a20ef-8b9d-41ed-a8a0-00b56b1ab304', 'b8845eae-77b4-46b7-99b2-1dbdbf44b9d7'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:54 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d" returned: 0 in 0.528s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:54 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d Apr 10 13:20:54 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:54 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:54 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:54 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" returned: 0 in 0.590s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Attempting download of 4ccac92a-bf64-4e00-af7f-9898d1d98b1d ((None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}])) to volume 3cf425e8-ef00-4b6a-9d12-89ec2d9e9535. {{(pid=82554) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9795853-ac20-41b0-9733-d7db03a503d1]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_4sy5np7t {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:54 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_4sy5np7t Apr 10 13:20:54 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:54 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e7d59ec3-85b4-4751-b819-bd5caaea6e0d" returned: 0 in 0.434s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Lock "cinder-quobyte-e7d59ec3-85b4-4751-b819-bd5caaea6e0d" released by "delete_volume" :: held 0.986s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Created reservations ['c6b955a9-47e3-4a65-9040-7cd4994606b0', '21463412-fb5c-4a92-873e-b5147d87f5ef', '4efef4b4-8a40-4c2c-b916-6991bf82302a', 'b2188ec5-028b-4378-96a7-5bceb85c82ba'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:55 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.609s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Deleted volume successfully. Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7919a0b9-fe84-4183-93ad-f18ab11a607a tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-b31f8927-1ddf-44c4-b3f2-880ea05f258c-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:55 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:55 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:55 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_4sy5np7t" returned: 0 in 0.558s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_4sy5np7t {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:55 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_4sy5np7t Apr 10 13:20:55 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-51eb0254-3e0c-49ab-ab0d-a0390b757306 tempest-VolumesActionsTest-833500359 None] Terminate volume connection completed successfully. Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-3006b0ac-b164-4926-b087-49cb9c7d595d-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-3006b0ac-b164-4926-b087-49cb9c7d595d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-quobyte-3006b0ac-b164-4926-b087-49cb9c7d595d" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-3006b0ac-b164-4926-b087-49cb9c7d595d" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[068210a8-a4df-4951-9496-209adeaa335d]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:55 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d Apr 10 13:20:55 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:55 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.478s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Deleted volume successfully. Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-246c0c35-b520-4a09-94d2-eaeac1f188d1 tempest-VolumesTransfersV355Test-53038306 None] Lock "cinder-e7d59ec3-85b4-4751-b819-bd5caaea6e0d-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:55 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_4sy5np7t" returned: 1 in 0.562s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_4sy5np7t' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f35d238-4c4a-4ac6-a4d0-2d7825bd0308]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:55 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD Apr 10 13:20:55 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-51eb0254-3e0c-49ab-ab0d-a0390b757306 tempest-VolumesActionsTest-833500359 None] Acquiring lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa-detach_volume" by "detach_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-51eb0254-3e0c-49ab-ab0d-a0390b757306 tempest-VolumesActionsTest-833500359 None] Lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-51eb0254-3e0c-49ab-ab0d-a0390b757306 tempest-VolumesActionsTest-833500359 None] Detaching volume 4a0297dd-1ade-42d3-ba34-9b07fb18d1aa from instance 861356ec-b151-4d74-853d-97faca84bc44. Apr 10 13:20:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-51eb0254-3e0c-49ab-ab0d-a0390b757306 tempest-VolumesActionsTest-833500359 None] Detach volume completed successfully. Apr 10 13:20:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-51eb0254-3e0c-49ab-ab0d-a0390b757306 tempest-VolumesActionsTest-833500359 None] Lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:56 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d" returned: 0 in 0.527s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:56 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d Apr 10 13:20:56 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:56 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] 4ccac92a-bf64-4e00-af7f-9898d1d98b1d was qcow2, converting to raw {{(pid=82554) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:56 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 Apr 10 13:20:56 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Flow 'volume_create_manager' (6ded5714-039b-4dac-9da9-49d7cd646857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c47b46-1949-471b-ae34-f65be666cef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-62a89b3d-7a84-474e-ac8c-8fa742709878 tempest-VolumesActionsTest-816741818 None] Acquiring lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa-detach_volume" by "detach_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c47b46-1949-471b-ae34-f65be666cef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-285312002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948250a3-6a71-433a-aaa8-3d4bd4c66df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf01e278df744119037ad647e61e36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:56Z,use_quota=True,user_id='083c1317620c4627b202a4df4ea525ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf53ac52-2134-4b23-86db-d2633813666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf53ac52-2134-4b23-86db-d2633813666e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2794174f-47f1-4462-a913-0b8bb6598d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2794174f-47f1-4462-a913-0b8bb6598d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948250a3-6a71-433a-aaa8-3d4bd4c66df9', 'volume_name': 'volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ae3307-5c68-4ca5-af48-72be9cbffffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ae3307-5c68-4ca5-af48-72be9cbffffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52438356-fdcc-444e-b082-8414a24d32c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:56 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Volume 948250a3-6a71-433a-aaa8-3d4bd4c66df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9', 'volume_size': 1} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-285312002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948250a3-6a71-433a-aaa8-3d4bd4c66df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf01e278df744119037ad647e61e36e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:20:56Z,use_quota=True,user_id='083c1317620c4627b202a4df4ea525ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Creating volume 948250a3-6a71-433a-aaa8-3d4bd4c66df9 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:20:56 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:56 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3006b0ac-b164-4926-b087-49cb9c7d595d" returned: 0 in 0.578s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:56 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9 1073741824 Apr 10 13:20:56 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-62a89b3d-7a84-474e-ac8c-8fa742709878 tempest-VolumesActionsTest-816741818 None] Lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa-detach_volume" acquired by "detach_volume" :: waited 0.088s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:56 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-62a89b3d-7a84-474e-ac8c-8fa742709878 tempest-VolumesActionsTest-816741818 None] Volume detach called, but volume not attached. Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-3006b0ac-b164-4926-b087-49cb9c7d595d" released by "delete_volume" :: held 1.155s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-62a89b3d-7a84-474e-ac8c-8fa742709878 tempest-VolumesActionsTest-816741818 None] Lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa-detach_volume" released by "detach_volume" :: held 0.017s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Created reservations ['081a7693-0930-452b-b1b8-bce747246062', '6714ccd7-69ad-4300-a890-af15417afc0c', '4cafb107-fe94-4cf5-a62f-4b0e6e4bbad5', 'a70225fd-3a18-4e87-b548-aec327959144'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:56 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:56 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Acquiring lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:57 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9 1073741824" returned: 0 in 0.668s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:57 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Acquiring lock "cinder-quobyte-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.593s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:57 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Deleted volume successfully. Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Lock "cinder-quobyte-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa" acquired by "delete_volume" :: waited 0.043s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:57 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9 Apr 10 13:20:57 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e7c4424a-23b7-4ac5-a62d-60943b926a5b tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-3006b0ac-b164-4926-b087-49cb9c7d595d-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[20adaedc-9389-410d-a61f-d90404f8306a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:57 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa Apr 10 13:20:57 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:57 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" returned: 0 in 1.242s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ccac92a-bf64-4e00-af7f-9898d1d98b1d_bqeh0mltdevstack@QuobyteHD, size 112.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:20:57 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Converted 112.00 MB image at 90.07 MB/s Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:57 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 1G Apr 10 13:20:57 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-d77ea128-c13c-4935-9a03-2b8fcbca53eb-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-d77ea128-c13c-4935-9a03-2b8fcbca53eb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-quobyte-d77ea128-c13c-4935-9a03-2b8fcbca53eb" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-d77ea128-c13c-4935-9a03-2b8fcbca53eb" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[94464cb2-3b43-468a-9ce8-9023739a4c31]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:57 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9" returned: 0 in 0.559s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52438356-fdcc-444e-b082-8414a24d32c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d5cd3d-3f27-46c3-ab7e-db9878f27735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:57 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Volume volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9 (948250a3-6a71-433a-aaa8-3d4bd4c66df9): created successfully Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d5cd3d-3f27-46c3-ab7e-db9878f27735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Flow 'volume_create_manager' (6ded5714-039b-4dac-9da9-49d7cd646857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:57 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a96cad85-c349-41de-b2b4-074f58921809 tempest-VolumesTransfersV355Test-614658687 None] Created volume successfully. Apr 10 13:20:57 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb Apr 10 13:20:57 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:58 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa" returned: 0 in 0.673s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:58 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 1G" returned: 0 in 0.538s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:58 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa Apr 10 13:20:58 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[907cc927-a114-4f35-9d08-95d7a5d75428]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:58 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 Apr 10 13:20:58 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:58 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb" returned: 0 in 0.571s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:58 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb Apr 10 13:20:58 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:58 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" returned: 0 in 0.492s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:58 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa" returned: 0 in 0.541s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Lock "cinder-quobyte-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa" released by "delete_volume" :: held 1.260s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Created reservations ['7a4ac893-402a-4ad3-8cf6-3eaad30f50d6', '0b1b83bd-0c85-43f8-bbe3-91a252ce2c99', 'f0e5ee07-e586-4e73-ad90-6845dbea9f84', 'ac755459-3adc-4fce-97ba-cdc13b469c37'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:58 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 Apr 10 13:20:58 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:58 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:58 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Acquiring lock "cinder-948250a3-6a71-433a-aaa8-3d4bd4c66df9-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Lock "cinder-948250a3-6a71-433a-aaa8-3d4bd4c66df9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Acquiring lock "cinder-quobyte-948250a3-6a71-433a-aaa8-3d4bd4c66df9" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Lock "cinder-quobyte-948250a3-6a71-433a-aaa8-3d4bd4c66df9" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f9ab8-58f7-462c-bdb9-4538455f472a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:59 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d77ea128-c13c-4935-9a03-2b8fcbca53eb" returned: 0 in 0.628s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-d77ea128-c13c-4935-9a03-2b8fcbca53eb" released by "delete_volume" :: held 1.254s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Created reservations ['a613f206-fbf4-4469-88ed-55347ded3efe', 'cf7513c7-c127-414e-92f7-cf34af60424e', '83aaac3e-3b53-4708-b9a7-1821f29284c5', '34995d89-ba81-42ee-8c3b-adb75dc1f61b'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:20:59 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9 Apr 10 13:20:59 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:59 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:20:59 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:59 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" returned: 1 in 0.696s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Downloaded image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d ((None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}])) to volume 3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 successfully. {{(pid=82554) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Temporary image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d for user 34cdbce16c3a47fdb9fa62328e0797b3 is deleted. {{(pid=82554) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.volume_utils [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Marking volume 3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 as bootable. {{(pid=82554) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Copying metadata from image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d to 3cf425e8-ef00-4b6a-9d12-89ec2d9e9535. {{(pid=82554) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Creating volume glance metadata for volume 3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 backed by image 4ccac92a-bf64-4e00-af7f-9898d1d98b1d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82554) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435a2a8b-3cca-4045-b41f-fa46054d26b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535', 'volume_size': 1, 'image_id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e95fcf91683e4d94b0f1e92d80301d16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ccac92a-bf64-4e00-af7f-9898d1d98b1d', 'created_at': datetime.datetime(2026, 4, 10, 11, 11, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 11, 11, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ccac92a-bf64-4e00-af7f-9898d1d98b1d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4466d85-0d5b-45b5-a35e-9c35cde3dad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:20:59 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Volume volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 (3cf425e8-ef00-4b6a-9d12-89ec2d9e9535): created successfully Apr 10 13:20:59 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4466d85-0d5b-45b5-a35e-9c35cde3dad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Flow 'volume_create_manager' (092a6f68-5e82-4756-8cb3-8cf6370d5d13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.644s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:59 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Deleted volume successfully. Apr 10 13:20:59 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-314440c3-881c-467e-aca4-10a03cb99cb1 tempest-VolumesExtendTest-167521160 None] Created volume successfully. Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a12f5969-c208-4f85-bcfe-867622791c4d tempest-VolumesActionsTest-816741818 None] Lock "cinder-4a0297dd-1ade-42d3-ba34-9b07fb18d1aa-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:59 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9" returned: 0 in 0.722s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:59 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9 Apr 10 13:20:59 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:20:59 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.657s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:20:59 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Deleted volume successfully. Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-47a2dc27-4b0b-4073-8037-e536dbad7904 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-d77ea128-c13c-4935-9a03-2b8fcbca53eb-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefb9617-0f50-4a3b-b8ad-0c86d66cbcb6]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-4834f0c9-5ee1-49c4-83ff-69bdf766394a-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-4834f0c9-5ee1-49c4-83ff-69bdf766394a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-quobyte-d7b1179d-b964-49ec-ad37-e95fa0814e0e" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-d7b1179d-b964-49ec-ad37-e95fa0814e0e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-quobyte-4834f0c9-5ee1-49c4-83ff-69bdf766394a" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-4834f0c9-5ee1-49c4-83ff-69bdf766394a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Deleting offline snapshot 4834f0c9-5ee1-49c4-83ff-69bdf766394a of volume d7b1179d-b964-49ec-ad37-e95fa0814e0e {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:20:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] snapshot_file for this snap is: volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ebcb17-219b-415a-becc-84cad3b5e3f5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:00 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 Apr 10 13:21:00 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:00 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a Apr 10 13:21:00 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:00 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-948250a3-6a71-433a-aaa8-3d4bd4c66df9" returned: 0 in 0.548s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Lock "cinder-quobyte-948250a3-6a71-433a-aaa8-3d4bd4c66df9" released by "delete_volume" :: held 1.294s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Created reservations ['05e0ddca-d4f7-435c-9202-357f913ca778', '9e6f30d0-8336-4e45-be0c-39c889cdf207', '181cc107-560c-42d5-aa42-8e4a25cac547', '4af03ed4-b9fd-4265-9477-33a7a7b4c303'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:00 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:00 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:00 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" returned: 0 in 0.556s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:00 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 Apr 10 13:21:00 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:00 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a" returned: 0 in 0.566s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c4fc98-2683-46f4-b126-f8825cba46be]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:00 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e Apr 10 13:21:00 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:00 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.591s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:00 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Deleted volume successfully. Apr 10 13:21:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d06a8c1-7c34-4e7c-8577-430156d5cb92 tempest-VolumesTransfersV355Test-53038306 None] Lock "cinder-948250a3-6a71-433a-aaa8-3d4bd4c66df9-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:01 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" returned: 1 in 0.644s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:21:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 2G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 2G" returned: 0 in 0.068s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.316s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-f4877d5f-9106-49ff-ae7c-8d45381ddbc5 tempest-VolumesExtendTest-167521160 None] Extend volume completed successfully. Apr 10 13:21:01 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e" returned: 0 in 0.676s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:01 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a Apr 10 13:21:01 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:01 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a" returned: 0 in 0.496s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:01 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a Apr 10 13:21:01 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Acquiring lock "cinder-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Lock "cinder-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Acquiring lock "cinder-quobyte-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Lock "cinder-quobyte-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" acquired by "delete_volume" :: waited 0.024s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09e38e3-d764-4df5-b527-896e78a1b2d2]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:02 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e.4834f0c9-5ee1-49c4-83ff-69bdf766394a" returned: 0 in 0.669s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:02 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 Apr 10 13:21:02 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-4834f0c9-5ee1-49c4-83ff-69bdf766394a" released by "_delete_snapshot" :: held 2.488s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-d7b1179d-b964-49ec-ad37-e95fa0814e0e" released by "delete_snapshot" :: held 2.500s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Created reservations ['e2942894-4a7e-46ae-af1b-6cf6b2c6bd31', '1b69e5f6-70eb-4763-a12f-a73b93cb4f03', 'b639dcb6-469f-4acd-914f-3fb33e80ba16', '3762f860-4aae-4a9f-bcd6-c812ea7b9ff1'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:02 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Delete snapshot completed successfully. Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2343fd12-31d2-4042-a937-f996bafb6e55 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-4834f0c9-5ee1-49c4-83ff-69bdf766394a-delete_snapshot" released by "delete_snapshot" :: held 2.622s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:02 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" returned: 0 in 0.594s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:03 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 Apr 10 13:21:03 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-d7b1179d-b964-49ec-ad37-e95fa0814e0e-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-d7b1179d-b964-49ec-ad37-e95fa0814e0e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "cinder-quobyte-d7b1179d-b964-49ec-ad37-e95fa0814e0e" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-d7b1179d-b964-49ec-ad37-e95fa0814e0e" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9b42a1-e8a4-482c-a359-84470e7e6a3f]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:03 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e Apr 10 13:21:03 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:03 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" returned: 1 in 0.629s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:03 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535 Apr 10 13:21:03 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:03 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e" returned: 0 in 0.615s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:03 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e Apr 10 13:21:03 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:04 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" returned: 0 in 0.479s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Lock "cinder-quobyte-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535" released by "delete_volume" :: held 1.773s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Created reservations ['1ae93f67-ae7a-416c-a275-e3f217469ff6', 'e4146c28-f72d-49e4-8a62-4c6efda8401d', 'ade6f573-2d53-43d7-86c0-c4e965603434', '42d62c30-1786-4087-bbf1-5119575d72b8'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:04 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:04 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:04 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d7b1179d-b964-49ec-ad37-e95fa0814e0e" returned: 0 in 0.502s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-quobyte-d7b1179d-b964-49ec-ad37-e95fa0814e0e" released by "delete_volume" :: held 1.157s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Created reservations ['ab7b6c20-364a-4e59-b658-bea56a8651a0', 'becc4777-e27d-4b8b-ba53-3517e4e572af', '0fa80484-3934-4045-b800-8a9429e43639', '9d45663b-9b8f-42a1-bd06-96c9a31f58d6'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:04 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:04 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:04 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.506s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:04 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Deleted volume successfully. Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1dc07577-d284-4a5f-91c3-3c36b359df96 tempest-VolumesExtendTest-167521160 None] Lock "cinder-3cf425e8-ef00-4b6a-9d12-89ec2d9e9535-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Flow 'volume_create_manager' (6ad2e9f7-b090-4c2a-91b2-bc54c1f1682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e789fd02-5b88-4e42-b5fb-c15dc695088f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e789fd02-5b88-4e42-b5fb-c15dc695088f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-29241407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14f3a8b-7be7-4718-bd04-c6ba3f3b6734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0047db434cdc4cc49ff3a27fde6c22ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:05Z,use_quota=True,user_id='34cdbce16c3a47fdb9fa62328e0797b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53aad4ab-5d8b-4b4d-982d-95800345c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53aad4ab-5d8b-4b4d-982d-95800345c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aceef15-aefd-44fc-bd77-8875602fac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aceef15-aefd-44fc-bd77-8875602fac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14f3a8b-7be7-4718-bd04-c6ba3f3b6734', 'volume_name': 'volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d60de6d-4890-477d-ac3f-0cc32862d130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d60de6d-4890-477d-ac3f-0cc32862d130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9639d5-764c-42c7-9b39-e2a9685f9638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:04 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Volume b14f3a8b-7be7-4718-bd04-c6ba3f3b6734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734', 'volume_size': 1} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-29241407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14f3a8b-7be7-4718-bd04-c6ba3f3b6734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0047db434cdc4cc49ff3a27fde6c22ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:05Z,use_quota=True,user_id='34cdbce16c3a47fdb9fa62328e0797b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Creating volume b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:04 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:04 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 1073741824 Apr 10 13:21:04 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:04 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.585s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:04 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:04 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Deleted volume successfully. Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-16a4721e-6a6b-4005-a30a-92201342d475 tempest-CreateVolumesFromSnapshotTest-72882361 None] Lock "cinder-d7b1179d-b964-49ec-ad37-e95fa0814e0e-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:05 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 1073741824" returned: 0 in 0.560s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:05 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 Apr 10 13:21:05 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Flow 'volume_create_manager' (2fc272d4-df0e-4722-8c2a-137e2b63c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba9a48d-2eff-4357-b8db-dbda96bab13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba9a48d-2eff-4357-b8db-dbda96bab13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1833168848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bbe92a-1653-4ba1-8bd9-d25418ee07d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceb4d6e45ee4497baca8c070a8b95c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:06Z,use_quota=True,user_id='3473439a05b644eba88130907fe723de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29d661d-8495-4333-8908-0b6a97f43960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29d661d-8495-4333-8908-0b6a97f43960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88432db-4cfc-492d-832c-832db9bd9d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88432db-4cfc-492d-832c-832db9bd9d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53bbe92a-1653-4ba1-8bd9-d25418ee07d3', 'volume_name': 'volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ec344e-730b-45cb-a399-f79e5fc1a202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ec344e-730b-45cb-a399-f79e5fc1a202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1be2ee7-a401-41bf-b731-54f62d59ff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:05 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Volume 53bbe92a-1653-4ba1-8bd9-d25418ee07d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3', 'volume_size': 1} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:05 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" returned: 0 in 0.534s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1833168848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bbe92a-1653-4ba1-8bd9-d25418ee07d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceb4d6e45ee4497baca8c070a8b95c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:06Z,use_quota=True,user_id='3473439a05b644eba88130907fe723de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Creating volume 53bbe92a-1653-4ba1-8bd9-d25418ee07d3 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:05 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9639d5-764c-42c7-9b39-e2a9685f9638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138a1d63-c841-4d37-a54c-9cb355806c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:06 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Volume volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 (b14f3a8b-7be7-4718-bd04-c6ba3f3b6734): created successfully Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138a1d63-c841-4d37-a54c-9cb355806c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:06 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3 1073741824 Apr 10 13:21:06 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Flow 'volume_create_manager' (6ad2e9f7-b090-4c2a-91b2-bc54c1f1682d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:06 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1b6437c5-d13d-4420-8031-909ea002cf69 tempest-VolumesExtendTest-167521160 None] Created volume successfully. Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (8909180b-510d-4e83-900d-7381c240cd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c5a357-0495-4746-b334-f68046cbda7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c5a357-0495-4746-b334-f68046cbda7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-789082788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dddbc9-7717-44af-bc79-3d528e7200fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:06Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cf8f2e-2304-4ed0-af43-b9e33cab094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cf8f2e-2304-4ed0-af43-b9e33cab094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bc9406-2519-4d50-b93d-25df66a3f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bc9406-2519-4d50-b93d-25df66a3f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51dddbc9-7717-44af-bc79-3d528e7200fd', 'volume_name': 'volume-51dddbc9-7717-44af-bc79-3d528e7200fd', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d31f33-9d92-4d12-ac0e-d5acb5a8c9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d31f33-9d92-4d12-ac0e-d5acb5a8c9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee3ad50-9c2c-4e88-ad59-a95a1ad1264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:06 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Volume 51dddbc9-7717-44af-bc79-3d528e7200fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51dddbc9-7717-44af-bc79-3d528e7200fd', 'volume_size': 1} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:06 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3 1073741824" returned: 0 in 0.593s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:06 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3 Apr 10 13:21:06 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=210,cinder:INSERT=79,cinder:UPDATE=269,cinder:DELETE=21 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=201,cinder:INSERT=84,cinder:UPDATE=260,cinder:DELETE=23 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:07 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3" returned: 0 in 0.521s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-789082788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dddbc9-7717-44af-bc79-3d528e7200fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:06Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Creating volume 51dddbc9-7717-44af-bc79-3d528e7200fd {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:07 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:07 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd 1073741824 Apr 10 13:21:07 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1be2ee7-a401-41bf-b731-54f62d59ff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb60a74-dbcc-4682-8472-2bde583adcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:07 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Volume volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3 (53bbe92a-1653-4ba1-8bd9-d25418ee07d3): created successfully Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb60a74-dbcc-4682-8472-2bde583adcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Flow 'volume_create_manager' (2fc272d4-df0e-4722-8c2a-137e2b63c612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (e9b29eb9-e4b8-422b-85f5-5f32eb40e7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91303ad-5da4-4a6c-bc6b-1d1037795c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:07 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-304e6dad-5486-425e-b232-37482d66eebc tempest-VolumesTransfersV357Test-1891892351 None] Created volume successfully. Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91303ad-5da4-4a6c-bc6b-1d1037795c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597715046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974019c3-2461-43d2-8804-584083578f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:07Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f494d69-bbae-4d1c-94c3-197b7a1dfafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f494d69-bbae-4d1c-94c3-197b7a1dfafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ae329b-d8e4-4051-ae1a-b6693a6787c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ae329b-d8e4-4051-ae1a-b6693a6787c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974019c3-2461-43d2-8804-584083578f08', 'volume_name': 'volume-974019c3-2461-43d2-8804-584083578f08', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea9b8e5-fff3-46d8-9b19-3eb2f5b23be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea9b8e5-fff3-46d8-9b19-3eb2f5b23be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b9a77c-5eac-44e6-bf94-8df92b7bd849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:07 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume 974019c3-2461-43d2-8804-584083578f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974019c3-2461-43d2-8804-584083578f08', 'volume_size': 1} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:07 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd 1073741824" returned: 0 in 0.471s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:07 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd Apr 10 13:21:07 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:08 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd" returned: 0 in 0.442s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Creating offline snapshot 1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 of volume b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee3ad50-9c2c-4e88-ad59-a95a1ad1264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51dddbc9-7717-44af-bc79-3d528e7200fd', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e59b15-1ede-4157-9caa-850dacfcbae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f2f3ad-d30c-4bfb-a287-9315b2a86c76]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:08 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Volume volume-51dddbc9-7717-44af-bc79-3d528e7200fd (51dddbc9-7717-44af-bc79-3d528e7200fd): created successfully Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e59b15-1ede-4157-9caa-850dacfcbae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (8909180b-510d-4e83-900d-7381c240cd4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:08 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-280a964e-72e9-4b00-928b-d221d950701b tempest-VolumesTransfersV357Test-1996633508 None] Transfer volume completed successfully. Apr 10 13:21:08 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-d945d1e0-10f2-48fb-9ec5-7006679e0fcb tempest-VolumesActionsTest-816741818 None] Created volume successfully. Apr 10 13:21:08 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 Apr 10 13:21:08 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:08 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" returned: 0 in 0.466s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:08 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 1G Apr 10 13:21:08 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Acquiring lock "cinder-53bbe92a-1653-4ba1-8bd9-d25418ee07d3-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Lock "cinder-53bbe92a-1653-4ba1-8bd9-d25418ee07d3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Acquiring lock "cinder-quobyte-53bbe92a-1653-4ba1-8bd9-d25418ee07d3" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Lock "cinder-quobyte-53bbe92a-1653-4ba1-8bd9-d25418ee07d3" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2653c-6802-44ae-a95b-fd7a797531af]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:09 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3 Apr 10 13:21:09 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:09 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 1G" returned: 0 in 0.522s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:09 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 Apr 10 13:21:09 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Acquiring lock "cinder-51dddbc9-7717-44af-bc79-3d528e7200fd-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Lock "cinder-51dddbc9-7717-44af-bc79-3d528e7200fd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Acquiring lock "cinder-quobyte-51dddbc9-7717-44af-bc79-3d528e7200fd" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Lock "cinder-quobyte-51dddbc9-7717-44af-bc79-3d528e7200fd" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ab8603-e6a8-4161-8dc9-5489d0e646f0]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:09 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd Apr 10 13:21:09 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:09 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3" returned: 0 in 0.522s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:09 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3 Apr 10 13:21:09 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:09 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59" returned: 0 in 0.495s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:09 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 is being set with open permissions: ugo+rw Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:09 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 Apr 10 13:21:09 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:09 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd" returned: 0 in 0.481s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:09 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd Apr 10 13:21:09 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:09 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-53bbe92a-1653-4ba1-8bd9-d25418ee07d3" returned: 0 in 0.427s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Lock "cinder-quobyte-53bbe92a-1653-4ba1-8bd9-d25418ee07d3" released by "delete_volume" :: held 0.973s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Created reservations ['850e536b-38c3-416e-b1c0-c557b431aa96', 'd3a7c26e-90fd-4f1e-9d93-c514cd5c975a', '88933fc5-0daf-44a0-83d5-ecd638e3cdb3', 'a1d607f2-f33d-45ab-b748-d6c400ca1b78'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:09 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59" returned: 0 in 0.418s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:10 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.info Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:10 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:10 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:10 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:10 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-51dddbc9-7717-44af-bc79-3d528e7200fd" returned: 0 in 0.501s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Lock "cinder-quobyte-51dddbc9-7717-44af-bc79-3d528e7200fd" released by "delete_volume" :: held 1.016s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Flow 'volume_create_manager' (ddc80b84-eae8-4038-b6be-42f1513c5648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294f0d9f-e52e-4568-a68a-cb7c5e6cf0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294f0d9f-e52e-4568-a68a-cb7c5e6cf0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-129943191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd1c82c-2ab4-424b-9ae7-fff48700784e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceb4d6e45ee4497baca8c070a8b95c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:10Z,use_quota=True,user_id='3473439a05b644eba88130907fe723de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa78e99-bd5f-4721-b4fa-3d511fd2e99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa78e99-bd5f-4721-b4fa-3d511fd2e99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda001ed-f801-4400-bd31-1d4309fdfdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda001ed-f801-4400-bd31-1d4309fdfdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfd1c82c-2ab4-424b-9ae7-fff48700784e', 'volume_name': 'volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a80a6fb-9b4b-4668-b0fe-f9b0d93099a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a80a6fb-9b4b-4668-b0fe-f9b0d93099a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cff9c58-dac3-4e18-b7f9-ef2146ed3f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:10 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Volume cfd1c82c-2ab4-424b-9ae7-fff48700784e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e', 'volume_size': 1} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Created reservations ['2e92a532-be2a-4c51-a286-bae58070a080', 'b5c37492-1520-4f76-937a-ec14425c1781', 'f2e38a06-0030-4245-803e-fe7e85b98e7d', 'ad54aeb9-d21a-4aea-9b8c-897229dbe8c0'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:10 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:10 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:10 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.info" returned: 0 in 0.515s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:10 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.info is being set with open permissions: ugo+rw Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:10 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.512s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:10 devstack sudo[87785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.info Apr 10 13:21:10 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Deleted volume successfully. Apr 10 13:21:10 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-238bad73-c3a4-4797-8670-0cbe25df4a42 tempest-VolumesTransfersV357Test-762337594 None] Lock "cinder-53bbe92a-1653-4ba1-8bd9-d25418ee07d3-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:10 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.413s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:10 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Deleted volume successfully. Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e0b24b40-edff-439a-b78a-78cd604a6cab tempest-VolumesActionsTest-833500359 None] Lock "cinder-51dddbc9-7717-44af-bc79-3d528e7200fd-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:10 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.info" returned: 0 in 0.405s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.904s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.731s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597715046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974019c3-2461-43d2-8804-584083578f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:07Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Creating volume 974019c3-2461-43d2-8804-584083578f08 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:10 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:10 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08 1073741824 Apr 10 13:21:10 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:10 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-d7c493a4-ddd1-4fa9-af3a-827c39bbfa4c tempest-VolumesExtendTest-167521160 None] Create snapshot completed successfully Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0a5a7190-a07e-4e8a-a0f5-2785d7fcda0a tempest-VolumesExtendTest-167521160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:11 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08 1073741824" returned: 0 in 0.542s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:11 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08 Apr 10 13:21:11 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (07ed8da7-d56c-4d95-a8c0-0c34e3b64f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1dffba-bcf5-4289-8ff4-0b07efd49a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1dffba-bcf5-4289-8ff4-0b07efd49a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1328664058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49fe8e3-0240-4d0f-a393-2067aadc0ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:12Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043741e2-ba1c-4b83-ade8-101cfcc1bcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043741e2-ba1c-4b83-ade8-101cfcc1bcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6468752-3644-43a1-8bcf-29e374e6f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6468752-3644-43a1-8bcf-29e374e6f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49fe8e3-0240-4d0f-a393-2067aadc0ed7', 'volume_name': 'volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed12782d-87b3-4339-98cd-640099b8f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed12782d-87b3-4339-98cd-640099b8f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813dcfdb-ea71-4317-b1ba-8a59754b4180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:11 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Volume c49fe8e3-0240-4d0f-a393-2067aadc0ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7', 'volume_size': 1} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:11 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08" returned: 0 in 0.430s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.521s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-129943191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd1c82c-2ab4-424b-9ae7-fff48700784e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ceb4d6e45ee4497baca8c070a8b95c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:10Z,use_quota=True,user_id='3473439a05b644eba88130907fe723de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Creating volume cfd1c82c-2ab4-424b-9ae7-fff48700784e {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:11 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b9a77c-5eac-44e6-bf94-8df92b7bd849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974019c3-2461-43d2-8804-584083578f08', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:11 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e 1073741824 Apr 10 13:21:11 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1664b26-680e-4963-a5f9-02f58d09838f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:11 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume volume-974019c3-2461-43d2-8804-584083578f08 (974019c3-2461-43d2-8804-584083578f08): created successfully Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1664b26-680e-4963-a5f9-02f58d09838f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (e9b29eb9-e4b8-422b-85f5-5f32eb40e7bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:12 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2916cf77-7ed1-406b-a6ce-e0954c63ac77 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created volume successfully. Apr 10 13:21:12 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e 1073741824" returned: 0 in 0.505s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:12 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e Apr 10 13:21:12 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (791983ab-dce5-46da-977b-659a5f097ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e536d4e9-7d15-4e09-81f4-890242e5230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e536d4e9-7d15-4e09-81f4-890242e5230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-686910125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:13Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2ede2a-0a3e-4a98-8632-217dec2bf3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2ede2a-0a3e-4a98-8632-217dec2bf3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ab8850-7936-4976-8e71-be48045ae98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ab8850-7936-4976-8e71-be48045ae98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4', 'volume_name': 'volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560e7e45-9bd0-44df-b2d1-bc4d0bed052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560e7e45-9bd0-44df-b2d1-bc4d0bed052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba46e536-7a13-4c2b-b6dd-5daca3d10963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume 0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4', 'volume_size': 1} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (8cbc9a66-5382-4c07-a2ed-6f9e64eea7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8177d6f5-9ab4-4ed0-ad31-ff2af57fb6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8177d6f5-9ab4-4ed0-ad31-ff2af57fb6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797005394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11c325d-6458-4be6-ac11-49546116b4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:13Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5060099e-836f-466e-8cc9-3fc2d98dd8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5060099e-836f-466e-8cc9-3fc2d98dd8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efca48ed-7ed0-4694-8f0c-00202a95d1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efca48ed-7ed0-4694-8f0c-00202a95d1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd11c325d-6458-4be6-ac11-49546116b4d2', 'volume_name': 'volume-d11c325d-6458-4be6-ac11-49546116b4d2', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d626039-fbbf-4a08-add8-e618e1677c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d626039-fbbf-4a08-add8-e618e1677c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81083f69-1111-4204-971d-d30e95accffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume d11c325d-6458-4be6-ac11-49546116b4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d11c325d-6458-4be6-ac11-49546116b4d2', 'volume_size': 1} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:12 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e" returned: 0 in 0.453s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0a5a7190-a07e-4e8a-a0f5-2785d7fcda0a tempest-VolumesExtendTest-167521160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.702s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cff9c58-dac3-4e18-b7f9-ef2146ed3f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94e471e-4f1b-4b4d-b389-ddb39bef6f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[705aa527-fdf2-4b9b-965d-61e6c039ac8e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0a5a7190-a07e-4e8a-a0f5-2785d7fcda0a tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:12 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Volume volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e (cfd1c82c-2ab4-424b-9ae7-fff48700784e): created successfully Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94e471e-4f1b-4b4d-b389-ddb39bef6f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Flow 'volume_create_manager' (ddc80b84-eae8-4038-b6be-42f1513c5648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:12 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2d887c72-5dc6-4ae1-9506-2f64dfc99f65 tempest-VolumesTransfersV357Test-1891892351 None] Created volume successfully. Apr 10 13:21:13 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:13 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (1e39b749-7fba-4675-a070-915cbb057d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040fe97c-ec22-4e65-a94a-8c9ce935c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040fe97c-ec22-4e65-a94a-8c9ce935c01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217676142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccce67d-8699-4c77-a06a-af8bb534eaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:13Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afc52d1-daa3-40e8-9140-545b4ec0a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afc52d1-daa3-40e8-9140-545b4ec0a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3308841e-8fce-4a58-b138-80d375d611a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3308841e-8fce-4a58-b138-80d375d611a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ccce67d-8699-4c77-a06a-af8bb534eaac', 'volume_name': 'volume-9ccce67d-8699-4c77-a06a-af8bb534eaac', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781e88c9-417a-460a-8a56-898d83fb60df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781e88c9-417a-460a-8a56-898d83fb60df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5004ef2a-2006-4d1c-8ca4-202a6536b302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume 9ccce67d-8699-4c77-a06a-af8bb534eaac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ccce67d-8699-4c77-a06a-af8bb534eaac', 'volume_size': 1} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (1c6fb29a-a165-410c-9f08-0212f6723345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484f7346-03eb-4252-9981-41df50c7a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484f7346-03eb-4252-9981-41df50c7a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-976879205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b99e35-e4e7-43c5-9c49-02d824c1d972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:13Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25641840-7a2a-4c93-89bb-7157cc50c811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25641840-7a2a-4c93-89bb-7157cc50c811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd308dc-37c4-45b7-9ab5-51b0162f46ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd308dc-37c4-45b7-9ab5-51b0162f46ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b99e35-e4e7-43c5-9c49-02d824c1d972', 'volume_name': 'volume-09b99e35-e4e7-43c5-9c49-02d824c1d972', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e99534-d192-4266-b49d-a19b60249bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e99534-d192-4266-b49d-a19b60249bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87991ead-d374-4de9-92d5-32282bc377bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume 09b99e35-e4e7-43c5-9c49-02d824c1d972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b99e35-e4e7-43c5-9c49-02d824c1d972', 'volume_size': 1} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (46c5f22d-4fe5-4828-9686-72884bfbcb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a906ce1c-8702-4269-a183-723ca7eeb90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a906ce1c-8702-4269-a183-723ca7eeb90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-324385834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a166a70-2e4e-48f7-b32b-df2e61a7a93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:13Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14100be-62ab-4579-9446-b995927557b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14100be-62ab-4579-9446-b995927557b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea868d09-6615-4b45-8abc-7328ab55684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea868d09-6615-4b45-8abc-7328ab55684d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a166a70-2e4e-48f7-b32b-df2e61a7a93b', 'volume_name': 'volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4d671b-9236-457a-928b-d63d5e0c4ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4d671b-9236-457a-928b-d63d5e0c4ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7a4d41-886c-4f5b-85c5-897745604808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:13 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume 6a166a70-2e4e-48f7-b32b-df2e61a7a93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b', 'volume_size': 1} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:13 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0a5a7190-a07e-4e8a-a0f5-2785d7fcda0a tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" returned: 0 in 0.611s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0a5a7190-a07e-4e8a-a0f5-2785d7fcda0a tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 2G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0a5a7190-a07e-4e8a-a0f5-2785d7fcda0a tempest-VolumesExtendTest-167521160 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 2G" returned: 0 in 0.075s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0a5a7190-a07e-4e8a-a0f5-2785d7fcda0a tempest-VolumesExtendTest-167521160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.713s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.850s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1328664058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49fe8e3-0240-4d0f-a393-2067aadc0ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:12Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Creating volume c49fe8e3-0240-4d0f-a393-2067aadc0ed7 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:13 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:13 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7 1073741824 Apr 10 13:21:13 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:13 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0a5a7190-a07e-4e8a-a0f5-2785d7fcda0a tempest-VolumesExtendTest-167521160 None] Extend volume completed successfully. Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Acquiring lock "cinder-cfd1c82c-2ab4-424b-9ae7-fff48700784e-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Lock "cinder-cfd1c82c-2ab4-424b-9ae7-fff48700784e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Acquiring lock "cinder-quobyte-cfd1c82c-2ab4-424b-9ae7-fff48700784e" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Lock "cinder-quobyte-cfd1c82c-2ab4-424b-9ae7-fff48700784e" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d57446-dad2-4ee8-a459-1369c9a1168d]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:13 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e Apr 10 13:21:13 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:14 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7 1073741824" returned: 0 in 0.578s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:14 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7 Apr 10 13:21:14 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:14 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e" returned: 0 in 0.494s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:14 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e Apr 10 13:21:14 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Acquiring lock "cinder-1c2eecd3-fb74-451a-a1ac-6b59d13e5d59-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Lock "cinder-1c2eecd3-fb74-451a-a1ac-6b59d13e5d59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Acquiring lock "cinder-quobyte-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Lock "cinder-quobyte-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Acquiring lock "cinder-quobyte-1c2eecd3-fb74-451a-a1ac-6b59d13e5d59" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Lock "cinder-quobyte-1c2eecd3-fb74-451a-a1ac-6b59d13e5d59" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Deleting offline snapshot 1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 of volume b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] snapshot_file for this snap is: volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b5bdde-528c-46ef-a181-3b2aa68f93f9]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:14 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 Apr 10 13:21:14 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:14 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7" returned: 0 in 0.471s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.982s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-686910125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:13Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Creating volume 0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:14 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (813dcfdb-ea71-4317-b1ba-8a59754b4180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3941578e-fb0e-487c-9cc0-6b4bf22b1a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:14 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 1073741824 Apr 10 13:21:14 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:14 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Volume volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7 (c49fe8e3-0240-4d0f-a393-2067aadc0ed7): created successfully Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3941578e-fb0e-487c-9cc0-6b4bf22b1a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (07ed8da7-d56c-4d95-a8c0-0c34e3b64f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:14 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cfd1c82c-2ab4-424b-9ae7-fff48700784e" returned: 0 in 0.483s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:14 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2731bae4-221a-474d-9219-747314cfa92a tempest-VolumesActionsTest-816741818 None] Created volume successfully. Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Lock "cinder-quobyte-cfd1c82c-2ab4-424b-9ae7-fff48700784e" released by "delete_volume" :: held 1.014s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Created reservations ['9e7ce2a5-afd4-42de-96e9-27c41b2c52bf', '8e800e31-99b2-4ac6-8204-ffe406ca3ef0', '5ed8cf05-9713-41e8-becf-8a9a9226e796', '066e6e76-b9e1-47cb-b6e3-8256cb91b5c1'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:14 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:14 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Acquiring lock "cinder-c49fe8e3-0240-4d0f-a393-2067aadc0ed7-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Lock "cinder-c49fe8e3-0240-4d0f-a393-2067aadc0ed7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Acquiring lock "cinder-quobyte-c49fe8e3-0240-4d0f-a393-2067aadc0ed7" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Lock "cinder-quobyte-c49fe8e3-0240-4d0f-a393-2067aadc0ed7" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[998224f5-4915-4861-9dfd-a46758fedc10]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:15 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59" returned: 0 in 0.604s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba16ea8-6e6c-4546-afb7-8dbbe9eb51c1]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:15 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7 Apr 10 13:21:15 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:15 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 Apr 10 13:21:15 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:15 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 1073741824" returned: 0 in 0.610s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:15 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 Apr 10 13:21:15 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.509s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:15 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Deleted volume successfully. Apr 10 13:21:15 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-14963db9-601e-41fa-9bd0-5ad2f7650366 tempest-VolumesTransfersV357Test-762337594 None] Lock "cinder-cfd1c82c-2ab4-424b-9ae7-fff48700784e-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:15 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7" returned: 0 in 0.543s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:15 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7 Apr 10 13:21:15 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:15 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" returned: 0 in 0.532s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:15 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 Apr 10 13:21:15 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:15 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4" returned: 0 in 0.491s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.968s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797005394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11c325d-6458-4be6-ac11-49546116b4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:13Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Creating volume d11c325d-6458-4be6-ac11-49546116b4d2 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:15 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba46e536-7a13-4c2b-b6dd-5daca3d10963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ab9a5c-3f62-4d0c-b0dd-00ce83acf259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:15 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2 1073741824 Apr 10 13:21:15 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:15 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 (0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4): created successfully Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ab9a5c-3f62-4d0c-b0dd-00ce83acf259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (791983ab-dce5-46da-977b-659a5f097ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:15 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4d8d3bbb-48f4-4ac3-ad78-f5b358803539 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created volume successfully. Apr 10 13:21:16 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c49fe8e3-0240-4d0f-a393-2067aadc0ed7" returned: 0 in 0.475s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Lock "cinder-quobyte-c49fe8e3-0240-4d0f-a393-2067aadc0ed7" released by "delete_volume" :: held 1.047s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Created reservations ['0b96bf3a-ca83-41eb-964d-6e27eccfad68', 'ec24960a-cb58-4af2-993b-aeb7190b62ed', '986b8dd5-cccd-4990-add4-23d2266f5076', '9bacb67e-a4d1-4147-b7ac-c0a5ff673338'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:16 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:16 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:16 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59" returned: 0 in 0.589s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:16 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59 Apr 10 13:21:16 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:16 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2 1073741824" returned: 0 in 0.624s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:16 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2 Apr 10 13:21:16 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:16 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.568s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:16 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Deleted volume successfully. Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2a661c39-8669-4340-8a18-9e1c2c43b009 tempest-VolumesActionsTest-833500359 None] Lock "cinder-c49fe8e3-0240-4d0f-a393-2067aadc0ed7-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:16 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734.1c2eecd3-fb74-451a-a1ac-6b59d13e5d59" returned: 0 in 0.561s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Lock "cinder-quobyte-1c2eecd3-fb74-451a-a1ac-6b59d13e5d59" released by "_delete_snapshot" :: held 2.344s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Lock "cinder-quobyte-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" released by "delete_snapshot" :: held 2.354s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Created reservations ['39edc255-9ae0-4be5-85c8-3859672a8269', 'b99e60b4-54d0-4a3a-a6e2-b5566f3cc462', 'c23ff4e7-2fa2-4d11-988d-b9cc753c561c', '5a4f0866-1f07-487f-aac6-c68e621f8e51'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:16 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Delete snapshot completed successfully. Apr 10 13:21:16 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9fc4ff8d-5eca-400c-85ae-c0abac91fd9d tempest-VolumesExtendTest-167521160 None] Lock "cinder-1c2eecd3-fb74-451a-a1ac-6b59d13e5d59-delete_snapshot" released by "delete_snapshot" :: held 2.438s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:17 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2" returned: 0 in 0.499s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.900s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217676142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccce67d-8699-4c77-a06a-af8bb534eaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:13Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Creating volume 9ccce67d-8699-4c77-a06a-af8bb534eaac {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:17 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81083f69-1111-4204-971d-d30e95accffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d11c325d-6458-4be6-ac11-49546116b4d2', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862e15dd-28fb-4dc0-acbd-5f884f993111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:17 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac 1073741824 Apr 10 13:21:17 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:17 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume volume-d11c325d-6458-4be6-ac11-49546116b4d2 (d11c325d-6458-4be6-ac11-49546116b4d2): created successfully Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862e15dd-28fb-4dc0-acbd-5f884f993111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (8cbc9a66-5382-4c07-a2ed-6f9e64eea7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:17 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-009a70b1-ba51-4cc0-9ed7-2a6ce3b08f94 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created volume successfully. Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (58972b4d-2368-49cf-8098-6529539efcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7b752f-6584-4a0e-9cda-85836cf5963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7b752f-6584-4a0e-9cda-85836cf5963d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1098474251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8cd6df-9254-48ef-a566-4c7b17494d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:18Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c106fb0a-d52d-4524-b942-59b0e98694a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c106fb0a-d52d-4524-b942-59b0e98694a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82130ad4-a441-40ff-837f-5655d3d95123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82130ad4-a441-40ff-837f-5655d3d95123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a8cd6df-9254-48ef-a566-4c7b17494d55', 'volume_name': 'volume-8a8cd6df-9254-48ef-a566-4c7b17494d55', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1921c2fe-7405-47af-822c-fa3c43bf6905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1921c2fe-7405-47af-822c-fa3c43bf6905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:17 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9fa1de-c493-4589-bec1-b472640bc723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:17 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Volume 8a8cd6df-9254-48ef-a566-4c7b17494d55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a8cd6df-9254-48ef-a566-4c7b17494d55', 'volume_size': 1} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac 1073741824" returned: 0 in 0.657s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:17 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac Apr 10 13:21:17 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Acquiring lock "cinder-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Lock "cinder-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Acquiring lock "cinder-quobyte-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Lock "cinder-quobyte-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0e9948-a476-4ac5-864b-75828f2ede55]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:17 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 Apr 10 13:21:17 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:18 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac" returned: 0 in 0.474s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.975s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-976879205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b99e35-e4e7-43c5-9c49-02d824c1d972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:13Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Creating volume 09b99e35-e4e7-43c5-9c49-02d824c1d972 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:18 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5004ef2a-2006-4d1c-8ca4-202a6536b302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccce67d-8699-4c77-a06a-af8bb534eaac', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f201f670-6565-4238-becf-e1e67571eeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:18 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume volume-9ccce67d-8699-4c77-a06a-af8bb534eaac (9ccce67d-8699-4c77-a06a-af8bb534eaac): created successfully Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f201f670-6565-4238-becf-e1e67571eeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:18 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972 1073741824 Apr 10 13:21:18 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (1e39b749-7fba-4675-a070-915cbb057d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:18 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-f5b81417-29a6-4b20-ad90-113e10851f69 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created volume successfully. Apr 10 13:21:18 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" returned: 0 in 0.553s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:18 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734 Apr 10 13:21:18 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:18 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" returned: 0 in 0.526s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Lock "cinder-quobyte-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734" released by "delete_volume" :: held 1.112s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:18 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Created reservations ['5b67508f-bf0f-4560-aa0f-7c25ab05dd36', '5e33572a-b75a-4e53-8e66-a58b3d0018f0', 'af672678-3ea0-4230-94da-16544dd0c868', '74ea4959-eaf7-49d6-9e33-c4926647d010'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:18 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972 1073741824" returned: 0 in 0.754s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:19 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972 Apr 10 13:21:19 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:19 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:19 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Flow 'volume_create_manager' (fd686266-2deb-4ff9-af4a-6d709aec8e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa884af0-f7eb-40ab-8f1d-954c1d31e9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa884af0-f7eb-40ab-8f1d-954c1d31e9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-271662097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345cf768-7df5-40d7-a2e4-f3c6c770897b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d123b0840406414f904c4ecc58a8dac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:19Z,use_quota=True,user_id='74ff9c344ad74cd794a6f6687b5d0d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d671d6-eaf4-4b0e-9d3d-d3c4bec519a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d671d6-eaf4-4b0e-9d3d-d3c4bec519a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7554b9a0-1c54-4838-8c33-55838b5c3307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7554b9a0-1c54-4838-8c33-55838b5c3307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '345cf768-7df5-40d7-a2e4-f3c6c770897b', 'volume_name': 'volume-345cf768-7df5-40d7-a2e4-f3c6c770897b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec45cb3f-dd2c-4304-8ddf-be0ef2c086c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec45cb3f-dd2c-4304-8ddf-be0ef2c086c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113ab825-20f9-4643-80ea-f2da33eb6302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:19 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Volume 345cf768-7df5-40d7-a2e4-f3c6c770897b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-345cf768-7df5-40d7-a2e4-f3c6c770897b', 'volume_size': 1} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:19 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.443s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:19 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Deleted volume successfully. Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c1f8fef2-e78a-4100-995e-3e0d2df515db tempest-VolumesExtendTest-167521160 None] Lock "cinder-b14f3a8b-7be7-4718-bd04-c6ba3f3b6734-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:19 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972" returned: 0 in 0.501s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.083s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-324385834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a166a70-2e4e-48f7-b32b-df2e61a7a93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8c1c6c2240417a8670d179ff2bf9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:13Z,use_quota=True,user_id='0cc983cfffa5415ebbe6149b9d0a873b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Creating volume 6a166a70-2e4e-48f7-b32b-df2e61a7a93b {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:19 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:19 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b 1073741824 Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87991ead-d374-4de9-92d5-32282bc377bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b99e35-e4e7-43c5-9c49-02d824c1d972', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:19 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b73fba9-84f2-40e6-9d76-56c779bad704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:19 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume volume-09b99e35-e4e7-43c5-9c49-02d824c1d972 (09b99e35-e4e7-43c5-9c49-02d824c1d972): created successfully Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b73fba9-84f2-40e6-9d76-56c779bad704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (1c6fb29a-a165-410c-9f08-0212f6723345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:19 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8bd8d503-76ff-488e-9153-f4ee50305ab5 tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created volume successfully. Apr 10 13:21:20 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b 1073741824" returned: 0 in 0.558s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:20 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b Apr 10 13:21:20 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:20 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b" returned: 0 in 0.467s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.860s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1098474251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8cd6df-9254-48ef-a566-4c7b17494d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:18Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Creating volume 8a8cd6df-9254-48ef-a566-4c7b17494d55 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:20 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7a4d41-886c-4f5b-85c5-897745604808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:20 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55 1073741824 Apr 10 13:21:20 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e40d9e-ee7c-492b-bc2f-6e5fc6439cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:20 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Volume volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b (6a166a70-2e4e-48f7-b32b-df2e61a7a93b): created successfully Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e40d9e-ee7c-492b-bc2f-6e5fc6439cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:20 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Flow 'volume_create_manager' (46c5f22d-4fe5-4828-9686-72884bfbcb1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:20 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8a16810f-bb4d-4332-b994-971d5e8dff5f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created volume successfully. Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-6a166a70-2e4e-48f7-b32b-df2e61a7a93b-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-6a166a70-2e4e-48f7-b32b-df2e61a7a93b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-quobyte-6a166a70-2e4e-48f7-b32b-df2e61a7a93b" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-6a166a70-2e4e-48f7-b32b-df2e61a7a93b" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f736fee-0da8-498e-916c-37b48d2652d8]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:21 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55 1073741824" returned: 0 in 0.637s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:21 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b Apr 10 13:21:21 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:21 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55 Apr 10 13:21:21 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:21 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b" returned: 0 in 0.505s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:21 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b Apr 10 13:21:21 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:21 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55" returned: 0 in 0.488s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.310s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-271662097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345cf768-7df5-40d7-a2e4-f3c6c770897b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d123b0840406414f904c4ecc58a8dac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:19Z,use_quota=True,user_id='74ff9c344ad74cd794a6f6687b5d0d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Creating volume 345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:21 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9fa1de-c493-4589-bec1-b472640bc723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8cd6df-9254-48ef-a566-4c7b17494d55', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed52196a-5704-449c-be27-96ed472bc1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:21 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Volume volume-8a8cd6df-9254-48ef-a566-4c7b17494d55 (8a8cd6df-9254-48ef-a566-4c7b17494d55): created successfully Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed52196a-5704-449c-be27-96ed472bc1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:21 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b 1073741824 Apr 10 13:21:21 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:21 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (58972b4d-2368-49cf-8098-6529539efcd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:21 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-473c476c-0ef2-4bf6-b02a-3f293c71eb98 tempest-VolumesActionsTest-816741818 None] Created volume successfully. Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Flow 'volume_create_manager' (aa516dbf-5b34-4955-82d3-8bbecc8a2766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d728498f-0542-49df-a66e-ac3063092ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d728498f-0542-49df-a66e-ac3063092ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-501632647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b10203-2284-4d08-b559-0efce3d1f89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f10078a9c2449885e4e76117171701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:22Z,use_quota=True,user_id='d44d0b2efea946359f197767b410bdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332745d8-c643-4549-b8fb-bc19b05ae8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332745d8-c643-4549-b8fb-bc19b05ae8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64f10e8-2bd9-43a5-8c23-0966d48d5932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64f10e8-2bd9-43a5-8c23-0966d48d5932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b10203-2284-4d08-b559-0efce3d1f89b', 'volume_name': 'volume-b4b10203-2284-4d08-b559-0efce3d1f89b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:22 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34207e07-c10e-4216-9d74-b4987f660803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34207e07-c10e-4216-9d74-b4987f660803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5499325e-048b-471d-af94-414b52018736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:22 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Volume b4b10203-2284-4d08-b559-0efce3d1f89b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b10203-2284-4d08-b559-0efce3d1f89b', 'volume_size': 1} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a166a70-2e4e-48f7-b32b-df2e61a7a93b" returned: 0 in 0.443s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-6a166a70-2e4e-48f7-b32b-df2e61a7a93b" released by "delete_volume" :: held 0.969s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created reservations ['8edb2155-7c1b-4745-9237-46cf9bad7b90', '70b077de-bfd7-4f5a-bf6d-b5fc16782815', '843bca43-bfee-4bba-b193-7a5785eec9b3', 'a2a1aca9-2222-46c1-b496-4feaff88b040'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:22 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:22 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-09b99e35-e4e7-43c5-9c49-02d824c1d972-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-09b99e35-e4e7-43c5-9c49-02d824c1d972-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-quobyte-09b99e35-e4e7-43c5-9c49-02d824c1d972" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-09b99e35-e4e7-43c5-9c49-02d824c1d972" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f74f52-f7d4-4e70-bb7c-64b0b430f804]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:22 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b 1073741824" returned: 0 in 0.583s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:22 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b Apr 10 13:21:22 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:22 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972 Apr 10 13:21:22 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_service.periodic_task [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82554) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:22 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:22 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:22 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.440s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:22 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Deleted volume successfully. Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ac92204-f1ef-4719-94cc-9a26fe71a23d tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-6a166a70-2e4e-48f7-b32b-df2e61a7a93b-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:22 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b" returned: 0 in 0.427s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.682s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-501632647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b10203-2284-4d08-b559-0efce3d1f89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f10078a9c2449885e4e76117171701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:22Z,use_quota=True,user_id='d44d0b2efea946359f197767b410bdc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Creating volume b4b10203-2284-4d08-b559-0efce3d1f89b {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:22 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:22 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b 1073741824 Apr 10 13:21:22 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113ab825-20f9-4643-80ea-f2da33eb6302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-345cf768-7df5-40d7-a2e4-f3c6c770897b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8fdac2-cc73-4f63-81dd-f334c6cc9f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:22 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Volume volume-345cf768-7df5-40d7-a2e4-f3c6c770897b (345cf768-7df5-40d7-a2e4-f3c6c770897b): created successfully Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8fdac2-cc73-4f63-81dd-f334c6cc9f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Flow 'volume_create_manager' (fd686266-2deb-4ff9-af4a-6d709aec8e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:22 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8abb485e-0849-4ce8-b9a6-9235bce72dc4 tempest-VolumesCloneTest-1355933342 None] Created volume successfully. Apr 10 13:21:22 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972" returned: 0 in 0.557s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:22 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972 Apr 10 13:21:22 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:22 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.414s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:22 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Acquiring lock "cinder-8a8cd6df-9254-48ef-a566-4c7b17494d55-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Lock "cinder-8a8cd6df-9254-48ef-a566-4c7b17494d55-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Acquiring lock "cinder-quobyte-8a8cd6df-9254-48ef-a566-4c7b17494d55" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Lock "cinder-quobyte-8a8cd6df-9254-48ef-a566-4c7b17494d55" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c27519a-1217-4c22-a6ad-ea56f4d37eb8]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:23 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55 Apr 10 13:21:23 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:23 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b 1073741824" returned: 0 in 0.544s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:23 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-09b99e35-e4e7-43c5-9c49-02d824c1d972" returned: 0 in 0.479s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-09b99e35-e4e7-43c5-9c49-02d824c1d972" released by "delete_volume" :: held 1.071s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:23 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b Apr 10 13:21:23 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created reservations ['5f55f987-882c-49ce-8eec-46533567dbb9', '5d9fa86d-639d-478d-8e37-6b02fca23dd9', '3f162a49-d9f1-429d-88f9-0de2f2e73059', 'bee52df0-68ed-4510-871a-700557dc24e6'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:23 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:23 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:23 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55" returned: 0 in 0.513s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:23 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55 Apr 10 13:21:23 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:23 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b" returned: 0 in 0.455s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5499325e-048b-471d-af94-414b52018736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b10203-2284-4d08-b559-0efce3d1f89b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3196e21f-3a08-4f2e-8abe-4097b7040ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:23 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Volume volume-b4b10203-2284-4d08-b559-0efce3d1f89b (b4b10203-2284-4d08-b559-0efce3d1f89b): created successfully Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3196e21f-3a08-4f2e-8abe-4097b7040ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Flow 'volume_create_manager' (aa516dbf-5b34-4955-82d3-8bbecc8a2766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:23 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4d3787e4-f317-428b-a9f3-e7051eb80997 tempest-VolumesNegativeTest-2074082809 None] Created volume successfully. Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:23 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.450s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Flow 'volume_create_manager' (f53db7d0-6f19-467e-9ac8-196f03852a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7bef2e6-c232-4c2f-9fb0-782fa1b741c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:23 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Deleted volume successfully. Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7bef2e6-c232-4c2f-9fb0-782fa1b741c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-78036572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26e7dc2-dff5-4ba9-989d-f72d9995b715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d123b0840406414f904c4ecc58a8dac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=345cf768-7df5-40d7-a2e4-f3c6c770897b,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:24Z,use_quota=True,user_id='74ff9c344ad74cd794a6f6687b5d0d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ec98e4-f488-4e4f-89c5-16007c1d6e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ec98e4-f488-4e4f-89c5-16007c1d6e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dfa53af-7ace-4df3-9349-66ed1d9897a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dfa53af-7ace-4df3-9349-66ed1d9897a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a26e7dc2-dff5-4ba9-989d-f72d9995b715', 'volume_name': 'volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715', 'volume_size': 2, 'source_volid': '345cf768-7df5-40d7-a2e4-f3c6c770897b', 'source_volstatus': 'available'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf968769-ace4-4748-be60-bb2bf5931d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf968769-ace4-4748-be60-bb2bf5931d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c019d90-8902-411d-b028-48e23e04871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:24 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Volume a26e7dc2-dff5-4ba9-989d-f72d9995b715: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715', 'volume_size': 2, 'source_volid': '345cf768-7df5-40d7-a2e4-f3c6c770897b', 'source_volstatus': 'available'} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-32ab24df-3841-43a6-b56e-daef98435d8f tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-09b99e35-e4e7-43c5-9c49-02d824c1d972-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:24 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Cloning volume 345cf768-7df5-40d7-a2e4-f3c6c770897b to volume a26e7dc2-dff5-4ba9-989d-f72d9995b715 Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Creating offline snapshot faad9089-ae87-4b0a-bf9d-1ba29337df08 of volume 345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b82e2dc-fd44-44ac-be9f-718f4f4e8c2b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:24 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b Apr 10 13:21:24 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:24 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8a8cd6df-9254-48ef-a566-4c7b17494d55" returned: 0 in 0.538s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Lock "cinder-quobyte-8a8cd6df-9254-48ef-a566-4c7b17494d55" released by "delete_volume" :: held 1.073s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Created reservations ['c9bc4a22-ae33-4446-870f-3f93f7199f8c', 'd7a0d99f-cfd7-4103-b9e0-88cc9bedd7ca', '193fa620-65b6-4c64-a448-1cece9976b14', '93383252-3f5c-452a-bcd7-ab0f45bcaf6e'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:24 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:24 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-9ccce67d-8699-4c77-a06a-af8bb534eaac-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-9ccce67d-8699-4c77-a06a-af8bb534eaac-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-quobyte-9ccce67d-8699-4c77-a06a-af8bb534eaac" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-9ccce67d-8699-4c77-a06a-af8bb534eaac" acquired by "delete_volume" :: waited 0.023s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea14b3e-cede-48ba-9e22-56c672b0c8ec]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:24 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b" returned: 0 in 0.581s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:24 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 1G Apr 10 13:21:24 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:24 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac Apr 10 13:21:24 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:24 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.523s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:24 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Deleted volume successfully. Apr 10 13:21:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad2c6d56-c3fa-4be3-9733-a86e863ce51a tempest-VolumesActionsTest-833500359 None] Lock "cinder-8a8cd6df-9254-48ef-a566-4c7b17494d55-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:25 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac" returned: 0 in 0.612s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:25 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac Apr 10 13:21:25 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:25 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 1G" returned: 0 in 0.650s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-345cf768-7df5-40d7-a2e4-f3c6c770897b -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:25 devstack sudo[87998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-345cf768-7df5-40d7-a2e4-f3c6c770897b -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 Apr 10 13:21:25 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (f450f702-35dd-45e2-8b51-a9261b8a16f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e7db39-e23e-4b4d-9d45-9789767bdde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e7db39-e23e-4b4d-9d45-9789767bdde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1887955757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd259daf-5927-4dc9-afd4-75cb9a4c55a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:25Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5599411b-b33a-4626-9575-03e2bcf5b4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5599411b-b33a-4626-9575-03e2bcf5b4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82cdea7-acf8-4083-9a6f-efcd6eee250c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82cdea7-acf8-4083-9a6f-efcd6eee250c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd259daf-5927-4dc9-afd4-75cb9a4c55a0', 'volume_name': 'volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1106ce21-69cd-47ea-8665-bbac3d3317d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1106ce21-69cd-47ea-8665-bbac3d3317d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ff68ec-989f-462e-b6f3-d0e192c336a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:25 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Volume cd259daf-5927-4dc9-afd4-75cb9a4c55a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0', 'volume_size': 1} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:25 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-9ccce67d-8699-4c77-a06a-af8bb534eaac" returned: 0 in 0.532s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-9ccce67d-8699-4c77-a06a-af8bb534eaac" released by "delete_volume" :: held 1.174s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:25 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-345cf768-7df5-40d7-a2e4-f3c6c770897b -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08" returned: 0 in 0.523s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:25 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 is being set with open permissions: ugo+rw Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created reservations ['ff510444-3187-4f4e-bd11-7729ce88f9b8', 'f789a658-8e32-42e2-95cc-34cbda805216', 'fffa51fd-dc52-4869-aaae-d01f8d657046', '8dc809f1-005a-4222-b792-0219a79f6bfb'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:25 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 Apr 10 13:21:25 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:25 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:25 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:26 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08" returned: 0 in 0.440s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:26 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.info Apr 10 13:21:26 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:26 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.427s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:26 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Deleted volume successfully. Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-52801580-d186-4db5-a607-4de10e1f490b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-9ccce67d-8699-4c77-a06a-af8bb534eaac-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:26 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-d11c325d-6458-4be6-ac11-49546116b4d2-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.info" returned: 0 in 0.455s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:26 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.info is being set with open permissions: ugo+rw Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-d11c325d-6458-4be6-ac11-49546116b4d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:26 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.info Apr 10 13:21:26 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-quobyte-d11c325d-6458-4be6-ac11-49546116b4d2" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-d11c325d-6458-4be6-ac11-49546116b4d2" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5058d9a9-947f-49c6-b7bd-a4a726238843]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:26 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2 Apr 10 13:21:26 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:27 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.info" returned: 0 in 0.436s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "cinder-quobyte-a26e7dc2-dff5-4ba9-989d-f72d9995b715" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-quobyte-a26e7dc2-dff5-4ba9-989d-f72d9995b715" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] snapshot: faad9089-ae87-4b0a-bf9d-1ba29337df08, volume: a26e7dc2-dff5-4ba9-989d-f72d9995b715, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0ae5f5-23a4-47ab-9786-6f1bd532f122]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:27 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 Apr 10 13:21:27 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:27 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2" returned: 0 in 0.488s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:27 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2 Apr 10 13:21:27 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:27 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08" returned: 0 in 0.487s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-345cf768-7df5-40d7-a2e4-f3c6c770897b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:21:27 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d11c325d-6458-4be6-ac11-49546116b4d2" returned: 0 in 0.397s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1abdeae-9269-406a-8fcc-fffc2b7f1feb]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-d11c325d-6458-4be6-ac11-49546116b4d2" released by "delete_volume" :: held 0.923s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created reservations ['0567b9bc-b0d6-4984-9117-9c41aa369956', '6e8e2afa-1505-4245-8418-d564d97a385d', 'c5bae728-e099-456f-9702-521023f3d487', 'b418879d-4f32-4531-842a-995d083d2c07'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:27 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b Apr 10 13:21:27 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:27 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:27 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-quobyte-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08f88c3-6a01-4b8f-b866-35b90f66f382]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:27 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 Apr 10 13:21:27 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:28 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b" returned: 0 in 0.546s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:28 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:21:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:28 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 Apr 10 13:21:28 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:28 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.505s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:28 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:28 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Deleted volume successfully. Apr 10 13:21:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2ae94964-0781-4263-aad3-4b09589dc4ce tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-d11c325d-6458-4be6-ac11-49546116b4d2-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:28 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4" returned: 0 in 0.510s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:28 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4 Apr 10 13:21:28 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:29 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4" returned: 0 in 0.798s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4" released by "delete_volume" :: held 1.340s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:29 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created reservations ['b7ff1ce9-e664-4cbb-aa87-0e6f2d21c1a0', '36038e71-9b7a-49bb-ba09-9c2a42c8cc22', '5827a6b5-efaf-44f8-be0c-1bdbcf031efd', 'f287f3b3-c385-46d3-ae4f-7e0ee24c0a46'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:29 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:29 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-974019c3-2461-43d2-8804-584083578f08-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-974019c3-2461-43d2-8804-584083578f08-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "cinder-quobyte-974019c3-2461-43d2-8804-584083578f08" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-974019c3-2461-43d2-8804-584083578f08" acquired by "delete_volume" :: waited 0.043s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60b7270-8207-497b-b37f-0c26203bbc43]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:30 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08 Apr 10 13:21:30 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:30 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715" returned: 0 in 2.583s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[68024d95-aa3c-4ae0-ba82-02157286dd1f]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:30 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 1.506s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:30 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Deleted volume successfully. Apr 10 13:21:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-53cd3e2a-ed41-4f1a-a095-05227982b88b tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-0ac5ee4f-1cab-4535-a5d8-ae455fd9e3b4-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:30 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b Apr 10 13:21:30 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:31 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08" returned: 0 in 0.642s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:31 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08 Apr 10 13:21:31 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:31 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b" returned: 0 in 0.717s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b, size 1024.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:21:31 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Converted 1024.00 MB image at 396.21 MB/s Apr 10 13:21:31 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 is being set with open permissions: ugo+rw Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:31 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 Apr 10 13:21:31 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:31 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-974019c3-2461-43d2-8804-584083578f08" returned: 0 in 0.486s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-quobyte-974019c3-2461-43d2-8804-584083578f08" released by "delete_volume" :: held 1.189s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Created reservations ['80d30c40-045b-4653-b8f4-5352c4b327b5', 'e9ced71d-f08a-472a-9196-6ab34c6640e7', '4584767f-65d3-4bf2-b0b1-7a6658260f3e', '1cba0e07-9720-4c6c-b1ea-3b2aeb62829a'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:31 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:31 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:32 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715" returned: 0 in 0.511s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-quobyte-a26e7dc2-dff5-4ba9-989d-f72d9995b715" released by "_copy_volume_from_snapshot" :: held 4.902s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "cinder-quobyte-faad9089-ae87-4b0a-bf9d-1ba29337df08" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-quobyte-faad9089-ae87-4b0a-bf9d-1ba29337df08" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Deleting offline snapshot faad9089-ae87-4b0a-bf9d-1ba29337df08 of volume 345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] snapshot_file for this snap is: volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d72ecd-d72c-4801-8d92-0eb46b574793]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:32 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 Apr 10 13:21:32 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:32 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.434s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:32 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Deleted volume successfully. Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4e7e90ed-a63e-497b-87b4-a4f181be8f6e tempest-CreateVolumesFromSourceVolumeTest-12420340 None] Lock "cinder-974019c3-2461-43d2-8804-584083578f08-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:32 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08" returned: 0 in 0.499s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-345cf768-7df5-40d7-a2e4-f3c6c770897b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6105fa0d-02dd-4fbf-927f-8281e991df2b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:32 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b Apr 10 13:21:32 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:33 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b" returned: 0 in 0.578s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:33 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 Apr 10 13:21:33 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:33 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08" returned: 0 in 0.569s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:33 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08 Apr 10 13:21:33 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:34 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b.faad9089-ae87-4b0a-bf9d-1ba29337df08" returned: 0 in 0.398s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-quobyte-faad9089-ae87-4b0a-bf9d-1ba29337df08" released by "_delete_snapshot" :: held 2.087s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.186s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.644s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1887955757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd259daf-5927-4dc9-afd4-75cb9a4c55a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:25Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Creating volume cd259daf-5927-4dc9-afd4-75cb9a4c55a0 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:34 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c019d90-8902-411d-b028-48e23e04871d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715', 'volume_size': 2, 'source_volid': '345cf768-7df5-40d7-a2e4-f3c6c770897b', 'source_volstatus': 'available'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:34 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0 1073741824 Apr 10 13:21:34 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97216f85-c45f-476e-9c2a-fb99a679da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:34 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Volume volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 (a26e7dc2-dff5-4ba9-989d-f72d9995b715): created successfully Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97216f85-c45f-476e-9c2a-fb99a679da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Flow 'volume_create_manager' (f53db7d0-6f19-467e-9ac8-196f03852a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:34 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-367f3a5f-4e05-42f2-a6d5-5e871e5af138 tempest-VolumesCloneTest-1355933342 None] Created volume successfully. Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "cinder-a26e7dc2-dff5-4ba9-989d-f72d9995b715-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-a26e7dc2-dff5-4ba9-989d-f72d9995b715-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:34 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "cinder-quobyte-a26e7dc2-dff5-4ba9-989d-f72d9995b715" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0 1073741824" returned: 0 in 0.546s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-quobyte-a26e7dc2-dff5-4ba9-989d-f72d9995b715" acquired by "delete_volume" :: waited 0.016s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eaaf5c-04cf-4951-9f8d-a6bca08446c1]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:34 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0 Apr 10 13:21:34 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:34 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 Apr 10 13:21:34 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:35 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0" returned: 0 in 0.411s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ff68ec-989f-462e-b6f3-d0e192c336a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a906f9a6-ed25-428f-bcd2-e79e46dfb938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:35 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Volume volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0 (cd259daf-5927-4dc9-afd4-75cb9a4c55a0): created successfully Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a906f9a6-ed25-428f-bcd2-e79e46dfb938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (f450f702-35dd-45e2-8b51-a9261b8a16f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:35 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c1525a00-86bb-4b8b-9a4b-89fb4d0ec8d8 tempest-VolumesActionsTest-816741818 None] Created volume successfully. Apr 10 13:21:35 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715" returned: 0 in 0.478s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:35 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715 Apr 10 13:21:35 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:35 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a26e7dc2-dff5-4ba9-989d-f72d9995b715" returned: 0 in 0.427s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-quobyte-a26e7dc2-dff5-4ba9-989d-f72d9995b715" released by "delete_volume" :: held 0.926s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Created reservations ['9ec41fe8-2380-4fa0-a90e-ddaabde23efd', '90120d46-5cf0-467e-8ab1-e059ba24c3a6', '6c807078-1379-46e8-a9f2-401d42a074da', '46940ba1-9efa-4257-b16a-e09426ad8aec'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:35 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:35 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "cinder-345cf768-7df5-40d7-a2e4-f3c6c770897b-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-345cf768-7df5-40d7-a2e4-f3c6c770897b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "cinder-quobyte-345cf768-7df5-40d7-a2e4-f3c6c770897b" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-quobyte-345cf768-7df5-40d7-a2e4-f3c6c770897b" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c450da8-46fc-45a1-bfe3-d1fe5dc0cf98]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:35 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b Apr 10 13:21:35 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Acquiring lock "cinder-cd259daf-5927-4dc9-afd4-75cb9a4c55a0-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Lock "cinder-cd259daf-5927-4dc9-afd4-75cb9a4c55a0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:36 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.463s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:36 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Deleted volume successfully. Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Acquiring lock "cinder-quobyte-cd259daf-5927-4dc9-afd4-75cb9a4c55a0" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d10c0319-a5ed-4301-bc00-2c8c7088d376 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-a26e7dc2-dff5-4ba9-989d-f72d9995b715-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Lock "cinder-quobyte-cd259daf-5927-4dc9-afd4-75cb9a4c55a0" acquired by "delete_volume" :: waited 0.022s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b3520e-54b3-46e2-9e73-27fa7d4b2712]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:36 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0 Apr 10 13:21:36 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:36 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b" returned: 0 in 0.771s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:36 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b Apr 10 13:21:36 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:37 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0" returned: 0 in 0.710s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:37 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0 Apr 10 13:21:37 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:37 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-345cf768-7df5-40d7-a2e4-f3c6c770897b" returned: 0 in 0.626s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-quobyte-345cf768-7df5-40d7-a2e4-f3c6c770897b" released by "delete_volume" :: held 1.432s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Created reservations ['604d93c2-3846-4f1d-9ea0-9d7089fdc973', '8c6007b5-c2d0-4e13-8b04-151dc199801a', '74923724-0f46-423a-ad86-a1e1ebe70251', '37962bea-087b-4a96-8f8c-b59e5ae65293'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:37 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:37 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:37 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cd259daf-5927-4dc9-afd4-75cb9a4c55a0" returned: 0 in 0.456s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Lock "cinder-quobyte-cd259daf-5927-4dc9-afd4-75cb9a4c55a0" released by "delete_volume" :: held 1.259s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Created reservations ['cb161c73-bbca-4c07-ac1f-181258c5da04', '89d09ae3-127a-4b86-8504-f2f1c1fc7e50', '11a7da37-a54e-4db0-aaca-e43199edc9ee', 'bb376a33-7ff4-42a4-a82d-f679c71ed4d6'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:37 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:37 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:37 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.465s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:37 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Deleted volume successfully. Apr 10 13:21:37 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1175879a-ab47-4ea6-85bd-a18abd581621 tempest-VolumesCloneTest-1355933342 None] Lock "cinder-345cf768-7df5-40d7-a2e4-f3c6c770897b-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:38 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.489s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:38 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Deleted volume successfully. Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-4b0f9169-ad1f-4732-b807-1ad6dc052b9c tempest-VolumesActionsTest-833500359 None] Lock "cinder-cd259daf-5927-4dc9-afd4-75cb9a4c55a0-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (4d38fdf1-8f4e-4126-b39c-70e4ce499258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde51d6a-41e7-4aa5-96f6-ee63450eaf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde51d6a-41e7-4aa5-96f6-ee63450eaf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1917212253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed758fd-adb3-4b1a-bde7-a1f8aeca053d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:39Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f869aa3-6b68-4c40-a70a-46194b608d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f869aa3-6b68-4c40-a70a-46194b608d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8383cd-a8f0-4923-b5b7-adb4b0cc43b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8383cd-a8f0-4923-b5b7-adb4b0cc43b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed758fd-adb3-4b1a-bde7-a1f8aeca053d', 'volume_name': 'volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dfd48f-9ad4-4132-9371-fa4a55a1f9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dfd48f-9ad4-4132-9371-fa4a55a1f9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5261ea2-477f-4edd-bbbe-13af7319f85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:38 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Volume 8ed758fd-adb3-4b1a-bde7-a1f8aeca053d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d', 'volume_size': 1} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1917212253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed758fd-adb3-4b1a-bde7-a1f8aeca053d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f934a413ce4149798c51453a1631b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:39Z,use_quota=True,user_id='eecfdff9a293419baa02486e2c20b31b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Creating volume 8ed758fd-adb3-4b1a-bde7-a1f8aeca053d {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:38 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:38 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d 1073741824 Apr 10 13:21:38 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:39 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d 1073741824" returned: 0 in 0.698s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:39 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d Apr 10 13:21:39 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Flow 'volume_create_manager' (21727c11-5e87-4bed-aac6-d4dde8d8e5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8bb284-cb4b-420d-94f7-9017d188836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:40 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8bb284-cb4b-420d-94f7-9017d188836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-630061906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429eb2c5-9c81-4b75-83fe-33c1c98e89ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934c80e5be642cfa1e36aac6b224452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:40Z,use_quota=True,user_id='49d3137b3c284ca198ee4aae78fa5d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad09a77-e065-457b-8442-1906b6d9a159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad09a77-e065-457b-8442-1906b6d9a159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e66e48-8764-484b-b0ec-25e2997702d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e66e48-8764-484b-b0ec-25e2997702d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429eb2c5-9c81-4b75-83fe-33c1c98e89ff', 'volume_name': 'volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff', 'volume_size': 2}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2283a94c-8183-41bc-b6d7-9a71195d0a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2283a94c-8183-41bc-b6d7-9a71195d0a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d1f349-29f7-4193-aea1-736c15e91bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:40 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Volume 429eb2c5-9c81-4b75-83fe-33c1c98e89ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff', 'volume_size': 2} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d" returned: 0 in 0.614s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-630061906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429eb2c5-9c81-4b75-83fe-33c1c98e89ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934c80e5be642cfa1e36aac6b224452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:40Z,use_quota=True,user_id='49d3137b3c284ca198ee4aae78fa5d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Creating volume 429eb2c5-9c81-4b75-83fe-33c1c98e89ff {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:40 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff 2147483648 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5261ea2-477f-4edd-bbbe-13af7319f85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6afb97f-313d-4092-97eb-23b758634e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:40 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff 2147483648 Apr 10 13:21:40 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:40 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Volume volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d (8ed758fd-adb3-4b1a-bde7-a1f8aeca053d): created successfully Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6afb97f-313d-4092-97eb-23b758634e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Flow 'volume_create_manager' (4d38fdf1-8f4e-4126-b39c-70e4ce499258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:40 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-d7352b01-9412-4333-a207-33a3262ccb9b tempest-VolumesActionsTest-816741818 None] Created volume successfully. Apr 10 13:21:40 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff 2147483648" returned: 0 in 0.610s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:40 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff Apr 10 13:21:40 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:41 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff" returned: 0 in 0.478s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d1f349-29f7-4193-aea1-736c15e91bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff', 'volume_size': 2}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76080052-c17c-45b0-b0dd-e806a190c3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:41 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Volume volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff (429eb2c5-9c81-4b75-83fe-33c1c98e89ff): created successfully Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76080052-c17c-45b0-b0dd-e806a190c3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Flow 'volume_create_manager' (21727c11-5e87-4bed-aac6-d4dde8d8e5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7618279c-d772-4d37-b115-24e711b1e749 tempest-VolumesCloneNegativeTest-301811527 None] Created volume successfully. Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Acquiring lock "cinder-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Lock "cinder-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Acquiring lock "cinder-quobyte-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Lock "cinder-quobyte-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f02fa4-7876-4d5a-9ee1-fc00abb7e3b5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:41 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d Apr 10 13:21:41 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:41 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d" returned: 0 in 0.486s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:41 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d Apr 10 13:21:41 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:42 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d" returned: 0 in 0.414s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Lock "cinder-quobyte-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d" released by "delete_volume" :: held 0.926s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Created reservations ['5cb41a64-fa46-4d7f-b02d-ff63fd318e91', 'cfc308d3-11ab-487c-9716-1363dad99fa3', '427d4408-d49b-451e-bcf3-8c8301c3013f', 'ee984c73-ddb7-4229-865d-06092f56dc65'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Acquiring lock "cinder-429eb2c5-9c81-4b75-83fe-33c1c98e89ff-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:42 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:42 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Lock "cinder-429eb2c5-9c81-4b75-83fe-33c1c98e89ff-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Acquiring lock "cinder-quobyte-429eb2c5-9c81-4b75-83fe-33c1c98e89ff" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Lock "cinder-quobyte-429eb2c5-9c81-4b75-83fe-33c1c98e89ff" acquired by "delete_volume" :: waited 0.015s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a127c3-b7ac-4529-9292-5c7567c774fb]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:42 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff Apr 10 13:21:42 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:42 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.494s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:42 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Deleted volume successfully. Apr 10 13:21:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0d56415a-3abf-46e2-b175-7f719c3e54a2 tempest-VolumesActionsTest-816741818 None] Lock "cinder-8ed758fd-adb3-4b1a-bde7-a1f8aeca053d-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:43 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff" returned: 0 in 0.604s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:43 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff Apr 10 13:21:43 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:43 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-429eb2c5-9c81-4b75-83fe-33c1c98e89ff" returned: 0 in 0.475s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Lock "cinder-quobyte-429eb2c5-9c81-4b75-83fe-33c1c98e89ff" released by "delete_volume" :: held 1.110s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Created reservations ['0654ade4-fd10-4745-b485-89a2532e8e15', '576cde98-ddf5-4b63-8c64-c632ef3a4ba0', '72c81d00-27cc-46c8-a3b5-abd412af1408', '75823e02-ac01-4901-b707-62452a3134d4'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:43 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:43 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:44 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.472s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:44 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:44 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Deleted volume successfully. Apr 10 13:21:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa3a626a-3ce2-4ee5-bd33-973c7ddb87b6 tempest-VolumesCloneNegativeTest-301811527 None] Lock "cinder-429eb2c5-9c81-4b75-83fe-33c1c98e89ff-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Flow 'volume_create_manager' (1fda1929-dfbf-4f52-94a6-7d6f8062cede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3d72df-85b2-42c7-82d2-9bf923a0463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3d72df-85b2-42c7-82d2-9bf923a0463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1904268614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a882c295d32c41438194ccbcf12dc264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:46Z,use_quota=True,user_id='417faded03bd43e688f1424462347711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ca5644-7a22-483e-9513-036708094579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ca5644-7a22-483e-9513-036708094579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f23f999-447e-4b8d-8e83-965a18308ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f23f999-447e-4b8d-8e83-965a18308ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7', 'volume_name': 'volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130ee6aa-5e5a-4ef0-b3f9-11744ddcbf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130ee6aa-5e5a-4ef0-b3f9-11744ddcbf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8408a5b-6496-40e5-9e6d-29af55e0891f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:46 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Volume ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7', 'volume_size': 1} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1904268614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a882c295d32c41438194ccbcf12dc264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:46Z,use_quota=True,user_id='417faded03bd43e688f1424462347711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Creating volume ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:46 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:46 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 1073741824 Apr 10 13:21:46 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:47 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 1073741824" returned: 0 in 0.598s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:47 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 Apr 10 13:21:47 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:47 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" returned: 0 in 0.538s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8408a5b-6496-40e5-9e6d-29af55e0891f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff36140-2f9d-4d72-b491-1a032d49a216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:47 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Volume volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 (ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7): created successfully Apr 10 13:21:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff36140-2f9d-4d72-b491-1a032d49a216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Flow 'volume_create_manager' (1fda1929-dfbf-4f52-94a6-7d6f8062cede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:47 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b6fdd675-ca44-4b4c-82d4-0f651a58fbe7 tempest-VolumesSnapshotListTestJSON-1290500293 None] Created volume successfully. Apr 10 13:21:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Creating offline snapshot ea082cc8-1a7a-4bcb-b24e-be70709e86a0 of volume ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:21:48 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2908d1-c5c7-47c1-ab9e-bf60fb1856fb]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:48 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 Apr 10 13:21:48 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:49 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" returned: 0 in 0.608s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:49 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 1G Apr 10 13:21:49 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Acquiring lock "cinder-b4b10203-2284-4d08-b559-0efce3d1f89b-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Lock "cinder-b4b10203-2284-4d08-b559-0efce3d1f89b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Acquiring lock "cinder-quobyte-b4b10203-2284-4d08-b559-0efce3d1f89b" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:21:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Lock "cinder-quobyte-b4b10203-2284-4d08-b559-0efce3d1f89b" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:21:49 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[850bd251-a2dd-4e17-8a33-19d533042500]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:49 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b Apr 10 13:21:49 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:50 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 1G" returned: 0 in 0.580s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:50 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 Apr 10 13:21:50 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:50 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b" returned: 0 in 0.558s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:50 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b Apr 10 13:21:50 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Flow 'volume_create_manager' (35d51373-c5fd-4c65-9791-cf0f0fd902a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec89f747-7476-46da-be3e-9dbdced63f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec89f747-7476-46da-be3e-9dbdced63f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1904911552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae066da7-4aba-415a-bf2f-34740753d7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b25cff1044465b8a857a5b9929576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:50Z,use_quota=True,user_id='576eaf44f80b4dc6add9e4be673a50fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7786c0-7d1e-44da-88e2-0f5f15d2bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7786c0-7d1e-44da-88e2-0f5f15d2bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d50a8c4-c1fe-43e9-8336-999b5d5a9934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d50a8c4-c1fe-43e9-8336-999b5d5a9934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae066da7-4aba-415a-bf2f-34740753d7e5', 'volume_name': 'volume-ae066da7-4aba-415a-bf2f-34740753d7e5', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6503ad2a-c756-4c6e-ad1a-f5758ecb3977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6503ad2a-c756-4c6e-ad1a-f5758ecb3977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1d12d0-9ac3-49a7-8552-535b8e712892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:50 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Volume ae066da7-4aba-415a-bf2f-34740753d7e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae066da7-4aba-415a-bf2f-34740753d7e5', 'volume_size': 1} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:50 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0" returned: 0 in 0.516s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:50 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 is being set with open permissions: ugo+rw Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:50 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 Apr 10 13:21:50 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:50 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b4b10203-2284-4d08-b559-0efce3d1f89b" returned: 0 in 0.427s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Lock "cinder-quobyte-b4b10203-2284-4d08-b559-0efce3d1f89b" released by "delete_volume" :: held 1.008s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Created reservations ['faf6c0c6-783d-4589-9d7a-26e38de149d6', 'b6251bb1-d084-4b9d-b3bc-a814e9d25940', '0bff2553-e8b5-4abb-9151-94b276ae31c1', '339a9b0c-4840-4981-9999-fd351388d22e'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:50 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:21:50 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:50 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0" returned: 0 in 0.436s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:51 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.info Apr 10 13:21:51 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:51 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.413s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:21:51 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Deleted volume successfully. Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c98ea0e5-6728-4b50-8889-9b1924e855ae tempest-VolumesNegativeTest-2074082809 None] Lock "cinder-b4b10203-2284-4d08-b559-0efce3d1f89b-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:21:51 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.info" returned: 0 in 0.418s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:51 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.info is being set with open permissions: ugo+rw Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:51 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.info Apr 10 13:21:51 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:51 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.info" returned: 0 in 0.414s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.040s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.411s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1904911552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae066da7-4aba-415a-bf2f-34740753d7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b25cff1044465b8a857a5b9929576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:50Z,use_quota=True,user_id='576eaf44f80b4dc6add9e4be673a50fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Creating volume ae066da7-4aba-415a-bf2f-34740753d7e5 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:51 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:51 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5 1073741824 Apr 10 13:21:51 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:51 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-18a47493-1d73-4fef-a749-830730fd5c68 tempest-VolumesSnapshotListTestJSON-1290500293 None] Create snapshot completed successfully Apr 10 13:21:52 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5 1073741824" returned: 0 in 0.543s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:52 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5 Apr 10 13:21:52 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:52 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5" returned: 0 in 0.486s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1d12d0-9ac3-49a7-8552-535b8e712892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae066da7-4aba-415a-bf2f-34740753d7e5', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aa43d6-3800-4673-8d4d-ed2b607c03ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:52 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Volume volume-ae066da7-4aba-415a-bf2f-34740753d7e5 (ae066da7-4aba-415a-bf2f-34740753d7e5): created successfully Apr 10 13:21:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aa43d6-3800-4673-8d4d-ed2b607c03ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:52 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Flow 'volume_create_manager' (35d51373-c5fd-4c65-9791-cf0f0fd902a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:52 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2988dfe1-fd19-4cb8-9f84-a3ab7f223d50 tempest-VolumesListAdminTestJSON-2111517379 None] Created volume successfully. Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] Creating offline snapshot a41a305b-9913-4606-914f-3f93d26c2512 of volume ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b1ed65-e407-4329-8170-291e0bebc7c0]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Flow 'volume_create_manager' (362e6700-2187-401a-95e3-52a7cc87a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9ba175-45ef-486e-96d7-ec9d65e27c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9ba175-45ef-486e-96d7-ec9d65e27c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-608539573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ff603c-a355-4fe5-a621-8ce91ac61cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ab6264d2624b49b996a6330cb190ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:53Z,use_quota=True,user_id='c4ce775ea0904925bd457e84a154c262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bcccb2-32db-488e-b1fa-7c508f6c4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bcccb2-32db-488e-b1fa-7c508f6c4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:53 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 Apr 10 13:21:53 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f83dd4-b97d-4629-8548-07bfffe28240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f83dd4-b97d-4629-8548-07bfffe28240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ff603c-a355-4fe5-a621-8ce91ac61cb8', 'volume_name': 'volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67090f1-0ec4-4d1d-abd8-8ba2b3984829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67090f1-0ec4-4d1d-abd8-8ba2b3984829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb82bcc-1c3b-42e3-8707-db06c2e7f057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:53 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Volume f4ff603c-a355-4fe5-a621-8ce91ac61cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8', 'volume_size': 1} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:53 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0" returned: 0 in 0.492s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:53 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 1G Apr 10 13:21:53 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Flow 'volume_create_manager' (f7e0ab74-6a0c-4a3a-bc32-4267ee79f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aeefb5c-7cf0-49be-acdb-364a97c1af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aeefb5c-7cf0-49be-acdb-364a97c1af41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-680775116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f398cb9-5910-4c45-8e69-cfd3bdfacb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b25cff1044465b8a857a5b9929576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:54Z,use_quota=True,user_id='576eaf44f80b4dc6add9e4be673a50fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7e9496-6813-4217-ad19-842b84ccf996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7e9496-6813-4217-ad19-842b84ccf996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510c0891-4fd5-4813-9ecb-6e5fd9787c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510c0891-4fd5-4813-9ecb-6e5fd9787c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f398cb9-5910-4c45-8e69-cfd3bdfacb1c', 'volume_name': 'volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac57c84-8c03-4328-9fd1-4efc57ce4a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac57c84-8c03-4328-9fd1-4efc57ce4a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7737f920-f369-4fcf-9d36-4a5fe5d46323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:53 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Volume 4f398cb9-5910-4c45-8e69-cfd3bdfacb1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c', 'volume_size': 1} Apr 10 13:21:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:54 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 1G" returned: 0 in 0.508s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:54 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 Apr 10 13:21:54 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:54 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512" returned: 0 in 0.414s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:54 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 is being set with open permissions: ugo+rw Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:54 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 Apr 10 13:21:54 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:54 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512" returned: 0 in 0.433s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-608539573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ff603c-a355-4fe5-a621-8ce91ac61cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ab6264d2624b49b996a6330cb190ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:53Z,use_quota=True,user_id='c4ce775ea0904925bd457e84a154c262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Creating volume f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:55 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:55 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 1073741824 Apr 10 13:21:55 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6980cddb-87cf-45d4-81cc-faf60dc80a1f tempest-VolumesSnapshotListTestJSON-1290500293 None] Create snapshot completed successfully Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:55 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 1073741824" returned: 0 in 0.483s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:55 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 Apr 10 13:21:55 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:55 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" returned: 0 in 0.414s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.072s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-680775116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f398cb9-5910-4c45-8e69-cfd3bdfacb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b25cff1044465b8a857a5b9929576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:54Z,use_quota=True,user_id='576eaf44f80b4dc6add9e4be673a50fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Creating volume 4f398cb9-5910-4c45-8e69-cfd3bdfacb1c {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:21:55 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb82bcc-1c3b-42e3-8707-db06c2e7f057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:55 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c 1073741824 Apr 10 13:21:55 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70f7c5a-728c-4127-9de9-b2edc8940e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:55 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Volume volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 (f4ff603c-a355-4fe5-a621-8ce91ac61cb8): created successfully Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70f7c5a-728c-4127-9de9-b2edc8940e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Flow 'volume_create_manager' (362e6700-2187-401a-95e3-52a7cc87a114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-f8b03761-2477-4a8e-b3ed-4242b825922c tempest-VolumeDependencyTests-783471176 None] Created volume successfully. Apr 10 13:21:56 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c 1073741824" returned: 0 in 0.523s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:56 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c Apr 10 13:21:56 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:56 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c" returned: 0 in 0.443s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.660s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] Creating offline snapshot 312dce9e-1085-418f-bda7-79f409cdc813 of volume ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7737f920-f369-4fcf-9d36-4a5fe5d46323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a234a5-07a9-41cd-b4b3-98ddbf5a200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[83985182-180f-4870-a932-68b2cb49bed3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:56 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Volume volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c (4f398cb9-5910-4c45-8e69-cfd3bdfacb1c): created successfully Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a234a5-07a9-41cd-b4b3-98ddbf5a200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Flow 'volume_create_manager' (f7e0ab74-6a0c-4a3a-bc32-4267ee79f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:56 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a3d722aa-7860-4573-8743-5f2d0726ab13 tempest-VolumesListAdminTestJSON-2111517379 None] Created volume successfully. Apr 10 13:21:57 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 Apr 10 13:21:57 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:57 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512" returned: 0 in 0.476s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:21:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:57 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 1G Apr 10 13:21:57 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:57 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 1G" returned: 0 in 0.498s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:57 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 Apr 10 13:21:57 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Flow 'volume_create_manager' (cd0b18e9-d12d-4ebc-9650-0ca6ed916d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f2f6b5-e276-444f-8261-88d12d32affc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f2f6b5-e276-444f-8261-88d12d32affc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1855562057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb610396-ea49-49cb-b1d7-2c80896b97c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b25cff1044465b8a857a5b9929576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:58Z,use_quota=True,user_id='576eaf44f80b4dc6add9e4be673a50fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8d197f-3bcf-4d40-bb55-56af68c6d2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8d197f-3bcf-4d40-bb55-56af68c6d2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df71ae54-336f-4a5b-bbd7-f4d3beef8307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df71ae54-336f-4a5b-bbd7-f4d3beef8307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb610396-ea49-49cb-b1d7-2c80896b97c8', 'volume_name': 'volume-cb610396-ea49-49cb-b1d7-2c80896b97c8', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e8d0e3-4362-48c0-9d1a-8ec617d529fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e8d0e3-4362-48c0-9d1a-8ec617d529fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3e5820-105d-4912-b65d-f6f8da5cfff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:21:58 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Volume cb610396-ea49-49cb-b1d7-2c80896b97c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb610396-ea49-49cb-b1d7-2c80896b97c8', 'volume_size': 1} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:21:58 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813" returned: 0 in 0.460s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:58 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 is being set with open permissions: ugo+rw Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:58 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 Apr 10 13:21:58 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:58 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813" returned: 0 in 0.408s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.330s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:21:58 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a174c6aa-1bf1-4f26-a0a1-764e3fe4246d tempest-VolumesSnapshotListTestJSON-1290500293 None] Create snapshot completed successfully Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Creating offline snapshot 9d309095-d92e-4483-9021-aa02120c2cfa of volume f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb01a9e-a878-4db7-9d65-83486e77136e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:21:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:58 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 Apr 10 13:21:58 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:59 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" returned: 0 in 0.463s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:59 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa 1G Apr 10 13:21:59 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:59 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 10 13:21:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa 1G" returned: 0 in 0.524s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:21:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:21:59 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa Apr 10 13:21:59 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:21:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-312dce9e-1085-418f-bda7-79f409cdc813-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-312dce9e-1085-418f-bda7-79f409cdc813-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-quobyte-312dce9e-1085-418f-bda7-79f409cdc813" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-312dce9e-1085-418f-bda7-79f409cdc813" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Deleting offline snapshot 312dce9e-1085-418f-bda7-79f409cdc813 of volume ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] snapshot_file for this snap is: volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fe0375-6ceb-4dbe-8ea4-0ace63c0a638]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:00 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 Apr 10 13:22:00 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:00 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa" returned: 0 in 0.457s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:00 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa is being set with open permissions: ugo+rw Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:00 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa Apr 10 13:22:00 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:00 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813" returned: 0 in 0.469s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7319bf-4f81-4ddb-bd6f-16650d99922b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:00 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 Apr 10 13:22:00 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:00 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa" returned: 0 in 0.417s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:00 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.info Apr 10 13:22:00 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:01 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512" returned: 0 in 0.490s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:01 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 Apr 10 13:22:01 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:01 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.info" returned: 0 in 0.426s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:01 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.info is being set with open permissions: ugo+rw Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:01 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.info Apr 10 13:22:01 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:01 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813" returned: 0 in 0.480s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:01 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813 Apr 10 13:22:01 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:01 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.info" returned: 0 in 0.425s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.325s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1855562057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb610396-ea49-49cb-b1d7-2c80896b97c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b25cff1044465b8a857a5b9929576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:21:58Z,use_quota=True,user_id='576eaf44f80b4dc6add9e4be673a50fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Creating volume cb610396-ea49-49cb-b1d7-2c80896b97c8 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:01 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:01 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8 1073741824 Apr 10 13:22:01 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-75b99cce-5a1f-4d43-8a23-b9f245605f92 tempest-VolumeDependencyTests-783471176 None] Create snapshot completed successfully Apr 10 13:22:01 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.312dce9e-1085-418f-bda7-79f409cdc813" returned: 0 in 0.420s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-312dce9e-1085-418f-bda7-79f409cdc813" released by "_delete_snapshot" :: held 1.902s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" released by "delete_snapshot" :: held 1.912s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Created reservations ['94593746-85ba-4550-b671-b2a52a037ba1', 'c7c7dc31-bd92-4bc3-926f-65032bd045cb', '6b69757c-f06a-4c05-bfb6-a646a9960fd2', 'd11f9207-279d-4fcd-b1fa-e80ebd1d30e2'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Delete snapshot completed successfully. Apr 10 13:22:01 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-cb0e0b01-ce20-4ea7-8f18-d41a91a6f3f0 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-312dce9e-1085-418f-bda7-79f409cdc813-delete_snapshot" released by "delete_snapshot" :: held 1.989s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-a41a305b-9913-4606-914f-3f93d26c2512-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-a41a305b-9913-4606-914f-3f93d26c2512-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-quobyte-a41a305b-9913-4606-914f-3f93d26c2512" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:02 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-a41a305b-9913-4606-914f-3f93d26c2512" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Deleting offline snapshot a41a305b-9913-4606-914f-3f93d26c2512 of volume ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] snapshot_file for this snap is: volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8 1073741824" returned: 0 in 0.522s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6113a1-6960-420d-8038-eda368cb89fb]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:02 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8 Apr 10 13:22:02 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:02 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 Apr 10 13:22:02 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:02 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8" returned: 0 in 0.418s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3e5820-105d-4912-b65d-f6f8da5cfff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb610396-ea49-49cb-b1d7-2c80896b97c8', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc54f96-94c3-459b-95be-0a5792ad8241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:02 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Volume volume-cb610396-ea49-49cb-b1d7-2c80896b97c8 (cb610396-ea49-49cb-b1d7-2c80896b97c8): created successfully Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc54f96-94c3-459b-95be-0a5792ad8241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Flow 'volume_create_manager' (cd0b18e9-d12d-4ebc-9650-0ca6ed916d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:02 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512" returned: 0 in 0.477s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:02 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b6c36d76-a7da-434c-9046-0eb7380fe101 tempest-VolumesListAdminTestJSON-2111517379 None] Created volume successfully. Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8285ea63-7a68-4fb5-93fc-5e0327bdbb4a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:02 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 Apr 10 13:22:02 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Flow 'volume_create_manager' (66fa2592-b181-43df-a055-28dbe98d8b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a584ad-189f-421d-8284-4eef996ce628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a584ad-189f-421d-8284-4eef996ce628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-955876781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acfafef-dbc5-42fd-90b1-8d226b416fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ab6264d2624b49b996a6330cb190ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d309095-d92e-4483-9021-aa02120c2cfa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:03Z,use_quota=True,user_id='c4ce775ea0904925bd457e84a154c262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d9d075-4d32-4395-bbc8-7f95f5e1fb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d9d075-4d32-4395-bbc8-7f95f5e1fb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ea838b-53aa-4da8-b5ea-40eb5d01822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ea838b-53aa-4da8-b5ea-40eb5d01822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5acfafef-dbc5-42fd-90b1-8d226b416fef', 'volume_name': 'volume-5acfafef-dbc5-42fd-90b1-8d226b416fef', 'volume_size': 1, 'snapshot_id': '9d309095-d92e-4483-9021-aa02120c2cfa'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0699f56b-c2bb-4d63-89ba-4f8e08357463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0699f56b-c2bb-4d63-89ba-4f8e08357463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff01346e-1a11-49c8-bed7-d572b8c901a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:03 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Volume 5acfafef-dbc5-42fd-90b1-8d226b416fef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5acfafef-dbc5-42fd-90b1-8d226b416fef', 'volume_size': 1, 'snapshot_id': '9d309095-d92e-4483-9021-aa02120c2cfa'} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-quobyte-9d309095-d92e-4483-9021-aa02120c2cfa-5acfafef-dbc5-42fd-90b1-8d226b416fef" by "_create_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-9d309095-d92e-4483-9021-aa02120c2cfa-5acfafef-dbc5-42fd-90b1-8d226b416fef" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Creating volume 5acfafef-dbc5-42fd-90b1-8d226b416fef from snapshot 9d309095-d92e-4483-9021-aa02120c2cfa {{(pid=82554) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-quobyte-5acfafef-dbc5-42fd-90b1-8d226b416fef" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-5acfafef-dbc5-42fd-90b1-8d226b416fef" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] snapshot: 9d309095-d92e-4483-9021-aa02120c2cfa, volume: 5acfafef-dbc5-42fd-90b1-8d226b416fef, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[15effc7b-44cd-4e0e-84f6-73d28af1cbfc]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:03 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa Apr 10 13:22:03 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:03 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0" returned: 0 in 0.524s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:03 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 Apr 10 13:22:03 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:03 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa" returned: 0 in 0.525s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a72208-d695-4f15-9572-95e272ab05bb]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:03 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512" returned: 0 in 0.511s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:03 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 Apr 10 13:22:03 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:03 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512 Apr 10 13:22:03 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Flow 'volume_create_manager' (28af2b6f-90b0-4c24-99d7-89b2f41db0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d22bd0-5299-4f78-abbc-9a76846f753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d22bd0-5299-4f78-abbc-9a76846f753a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd7a260-ccd3-425f-9dcb-f1108c89eea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9a1aab8c284c32ba5bd34bcaa7125a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:04Z,use_quota=True,user_id='f9512f7d45064522a6ca58f39549ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f16615e-e0fe-48fe-a4ed-c67234e04d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f16615e-e0fe-48fe-a4ed-c67234e04d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84066fb7-a741-4197-9071-4260a13d50b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84066fb7-a741-4197-9071-4260a13d50b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd7a260-ccd3-425f-9dcb-f1108c89eea9', 'volume_name': 'volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b85d979-b291-446f-8c5e-385560b9c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b85d979-b291-446f-8c5e-385560b9c577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d840b62-dcb0-4eae-8f3f-a89beee758ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:03 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Volume dfd7a260-ccd3-425f-9dcb-f1108c89eea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9', 'volume_size': 1} Apr 10 13:22:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:04 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.a41a305b-9913-4606-914f-3f93d26c2512" returned: 0 in 0.459s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:04 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" returned: 0 in 0.538s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:04 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:22:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-a41a305b-9913-4606-914f-3f93d26c2512" released by "_delete_snapshot" :: held 2.049s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" released by "delete_snapshot" :: held 2.066s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:04 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef Apr 10 13:22:04 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:04 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Created reservations ['700ad150-0f1e-49d2-83fc-694527d85fe7', 'a907cc4d-18fd-4e42-b6fe-b930a1205cc4', '49521a4a-4e7d-4402-abac-9dc513a1a12a', 'a6f674ca-13f2-4fd6-8d22-53f098232ed3'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:04 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Delete snapshot completed successfully. Apr 10 13:22:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c49d7229-66f0-4193-be01-98ae50fb2300 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-a41a305b-9913-4606-914f-3f93d26c2512-delete_snapshot" released by "delete_snapshot" :: held 2.147s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-ea082cc8-1a7a-4bcb-b24e-be70709e86a0-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-ea082cc8-1a7a-4bcb-b24e-be70709e86a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-quobyte-ea082cc8-1a7a-4bcb-b24e-be70709e86a0" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-ea082cc8-1a7a-4bcb-b24e-be70709e86a0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Deleting offline snapshot ea082cc8-1a7a-4bcb-b24e-be70709e86a0 of volume ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:22:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] snapshot_file for this snap is: volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:22:05 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdaf897-cd68-450c-9ee1-8267e24174e7]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:05 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 Apr 10 13:22:05 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:06 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef" returned: 0 in 2.027s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[896fe4f8-a0df-4f18-b2a9-01d34c0ac2ae]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:06 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 Apr 10 13:22:06 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:06 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0" returned: 0 in 0.939s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf5f1ef-c367-42e8-ab74-0527a8be9a9a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:06 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 Apr 10 13:22:06 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:06 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" returned: 0 in 0.601s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:22:06 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Converted 1024.00 MB image at 504.86 MB/s Apr 10 13:22:06 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef is being set with open permissions: ugo+rw Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:06 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef Apr 10 13:22:06 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:06 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" returned: 0 in 0.477s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:06 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 Apr 10 13:22:06 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:07 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef" returned: 0 in 0.426s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-5acfafef-dbc5-42fd-90b1-8d226b416fef" released by "_copy_volume_from_snapshot" :: held 4.172s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-9d309095-d92e-4483-9021-aa02120c2cfa-5acfafef-dbc5-42fd-90b1-8d226b416fef" released by "_create_volume_from_snapshot" :: held 4.189s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.197s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.341s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd7a260-ccd3-425f-9dcb-f1108c89eea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9a1aab8c284c32ba5bd34bcaa7125a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:04Z,use_quota=True,user_id='f9512f7d45064522a6ca58f39549ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Creating volume dfd7a260-ccd3-425f-9dcb-f1108c89eea9 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:07 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=171,cinder:UPDATE=235,cinder:DELETE=17,cinder:INSERT=58 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:22:07 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9 1073741824 Apr 10 13:22:07 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:UPDATE=238,cinder:DELETE=28,cinder:SELECT=168,cinder:INSERT=52 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff01346e-1a11-49c8-bed7-d572b8c901a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5acfafef-dbc5-42fd-90b1-8d226b416fef', 'volume_size': 1, 'snapshot_id': '9d309095-d92e-4483-9021-aa02120c2cfa'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca0b669-d44f-4a87-9fdb-0064dd8a73a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:07 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Volume volume-5acfafef-dbc5-42fd-90b1-8d226b416fef (5acfafef-dbc5-42fd-90b1-8d226b416fef): created successfully Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca0b669-d44f-4a87-9fdb-0064dd8a73a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Flow 'volume_create_manager' (66fa2592-b181-43df-a055-28dbe98d8b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:07 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-26ecbdd1-9fb6-4de2-aa28-c8557c39875e tempest-VolumeDependencyTests-783471176 None] Created volume successfully. Apr 10 13:22:07 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0" returned: 0 in 0.489s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:07 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0 Apr 10 13:22:07 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:07 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9 1073741824" returned: 0 in 0.518s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:07 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9 Apr 10 13:22:07 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:07 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7.ea082cc8-1a7a-4bcb-b24e-be70709e86a0" returned: 0 in 0.460s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-ea082cc8-1a7a-4bcb-b24e-be70709e86a0" released by "_delete_snapshot" :: held 2.445s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" released by "delete_snapshot" :: held 2.471s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Created reservations ['5c0e60eb-e34c-4dc8-87ff-d04d59d5e3fa', 'c197de80-a7d1-4582-ab80-0c5c575cce7b', '969f2d92-e875-4adf-8d51-37f73f409d6b', 'f42f3649-37f4-4443-9f23-cc7698493c74'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:07 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Delete snapshot completed successfully. Apr 10 13:22:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a7bd63ca-b915-456f-9265-f1fdf2df2375 tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-ea082cc8-1a7a-4bcb-b24e-be70709e86a0-delete_snapshot" released by "delete_snapshot" :: held 2.570s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:08 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d840b62-dcb0-4eae-8f3f-a89beee758ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85dfdfa-cf54-4d89-ac82-776beb1a2a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:08 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Volume volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9 (dfd7a260-ccd3-425f-9dcb-f1108c89eea9): created successfully Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85dfdfa-cf54-4d89-ac82-776beb1a2a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Flow 'volume_create_manager' (28af2b6f-90b0-4c24-99d7-89b2f41db0aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:08 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-d8e555f0-ae2b-4f2a-bc99-02627b05e471 tempest-VolumesListAdminTestJSON-1724375642 None] Created volume successfully. Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-9d309095-d92e-4483-9021-aa02120c2cfa-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-9d309095-d92e-4483-9021-aa02120c2cfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-quobyte-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-quobyte-9d309095-d92e-4483-9021-aa02120c2cfa" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-9d309095-d92e-4483-9021-aa02120c2cfa" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Deleting offline snapshot 9d309095-d92e-4483-9021-aa02120c2cfa of volume f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] snapshot_file for this snap is: volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c7fbaa-6189-464d-bdb6-d5feff1971c3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:08 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa Apr 10 13:22:08 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e905e0-8554-4acd-8192-9414fb2a45fb]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:08 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 Apr 10 13:22:08 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:08 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa" returned: 0 in 0.520s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21bb5ef-e835-4f5b-9e55-9d0e3e43ee2d]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:08 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 Apr 10 13:22:08 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:09 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" returned: 0 in 0.483s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:09 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7 Apr 10 13:22:09 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Acquiring lock "cinder-dfd7a260-ccd3-425f-9dcb-f1108c89eea9-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Lock "cinder-dfd7a260-ccd3-425f-9dcb-f1108c89eea9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Acquiring lock "cinder-quobyte-dfd7a260-ccd3-425f-9dcb-f1108c89eea9" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:09 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" returned: 0 in 0.489s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Lock "cinder-quobyte-dfd7a260-ccd3-425f-9dcb-f1108c89eea9" acquired by "delete_volume" :: waited 0.021s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:09 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa Apr 10 13:22:09 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f0877b-0f25-4b30-a23d-a97c6bcc6285]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "cinder-cb610396-ea49-49cb-b1d7-2c80896b97c8-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-cb610396-ea49-49cb-b1d7-2c80896b97c8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "cinder-quobyte-cb610396-ea49-49cb-b1d7-2c80896b97c8" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:09 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9 Apr 10 13:22:09 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-quobyte-cb610396-ea49-49cb-b1d7-2c80896b97c8" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[603b82a3-1775-426a-b0e2-d56df4a64a1c]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:09 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8 Apr 10 13:22:09 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:09 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" returned: 0 in 0.425s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-quobyte-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7" released by "delete_volume" :: held 0.944s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Created reservations ['344231c8-c659-4235-8d3d-8557a22b74ee', '3ed5d610-31ae-4200-9c31-78044be9d052', '0e3b98ab-7690-4732-8c54-cc517c8f5a40', 'e1bf0a32-cfe4-44cc-b86c-86e6182f082d'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:09 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:09 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:10 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa" returned: 0 in 0.603s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:10 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa Apr 10 13:22:10 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:10 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8" returned: 0 in 0.559s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:10 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8 Apr 10 13:22:10 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:10 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9" returned: 0 in 0.733s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:10 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9 Apr 10 13:22:10 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:10 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.583s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:10 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Deleted volume successfully. Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-80252e63-92a5-4a72-8a2a-00a328ca998f tempest-VolumesSnapshotListTestJSON-1290500293 None] Lock "cinder-ed57e3ce-f3fa-4b74-8121-5eb2f9b4c6b7-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:10 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8.9d309095-d92e-4483-9021-aa02120c2cfa" returned: 0 in 0.505s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-9d309095-d92e-4483-9021-aa02120c2cfa" released by "_delete_snapshot" :: held 2.171s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" released by "delete_snapshot" :: held 2.183s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Created reservations ['ccad52cc-5d37-4047-887c-ae27c4c12a1b', 'b43474c0-017c-4648-9836-0d577b00776b', '32a3e8c9-66e2-4012-94e7-0d1a30d89096', '3133c5b1-1e4b-4c56-8f67-1c484a6eae42'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:10 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Delete snapshot completed successfully. Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6040249c-8ab9-4c91-b53a-77b3dfca73e0 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-9d309095-d92e-4483-9021-aa02120c2cfa-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:10 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb610396-ea49-49cb-b1d7-2c80896b97c8" returned: 0 in 0.577s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-quobyte-cb610396-ea49-49cb-b1d7-2c80896b97c8" released by "delete_volume" :: held 1.161s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Created reservations ['ab90850e-e715-44bb-833c-890b05326d03', '402a6ce8-afec-4aa8-b614-7c7f4afc51a0', '550034e7-446c-44f2-951a-aba7535b6946', '3af77370-d554-4cf3-8a03-bdc2b6a2fd48'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:10 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dfd7a260-ccd3-425f-9dcb-f1108c89eea9" returned: 0 in 0.563s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Lock "cinder-quobyte-dfd7a260-ccd3-425f-9dcb-f1108c89eea9" released by "delete_volume" :: held 1.325s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Created reservations ['1f67736d-363f-490f-b7f2-9bc6a9ab531e', '56036932-8e32-4ed9-aa76-6444e0c59f5e', '0e448432-390a-4877-8b87-fc8391d9d4af', 'a285c56b-b5e5-4593-b28b-61f896254bfe'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:10 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:10 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:10 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:10 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:11 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.479s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:11 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Deleted volume successfully. Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-e9b9f936-5960-4b37-9369-92d72a27bbf1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-cb610396-ea49-49cb-b1d7-2c80896b97c8-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:11 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.469s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:11 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Deleted volume successfully. Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-24678f2a-d901-463e-95b3-0d52d69088b1 tempest-VolumesListAdminTestJSON-1724375642 None] Lock "cinder-dfd7a260-ccd3-425f-9dcb-f1108c89eea9-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-f4ff603c-a355-4fe5-a621-8ce91ac61cb8-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-f4ff603c-a355-4fe5-a621-8ce91ac61cb8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-quobyte-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[05446b02-512a-471d-8938-65a94e423d09]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "cinder-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:11 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 Apr 10 13:22:11 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "cinder-quobyte-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-quobyte-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6ea82c-9418-4aa0-b9f9-82f116edca73]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:11 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c Apr 10 13:22:11 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Flow 'volume_create_manager' (189c987c-5b7e-4bd5-9071-db59c8bf5fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdd77e1-342b-4742-9adf-08dab3f10bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdd77e1-342b-4742-9adf-08dab3f10bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-464609643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0080e976-715c-4380-b36a-86845ca5404a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de55dee2c55a4325aae7f4e39356eef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:12Z,use_quota=True,user_id='60c13bb12543406e9f62ff699c008333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7cd3a9b-ea40-48e3-a350-13f2fc788e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7cd3a9b-ea40-48e3-a350-13f2fc788e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0788f8d2-f8f1-4704-b8d4-f2ef7915a235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0788f8d2-f8f1-4704-b8d4-f2ef7915a235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0080e976-715c-4380-b36a-86845ca5404a', 'volume_name': 'volume-0080e976-715c-4380-b36a-86845ca5404a', 'volume_size': 2}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37857188-7125-4791-b9a9-b22990dc8da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37857188-7125-4791-b9a9-b22990dc8da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86098938-e96b-412a-91af-e2843b37ecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:11 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Volume 0080e976-715c-4380-b36a-86845ca5404a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0080e976-715c-4380-b36a-86845ca5404a', 'volume_size': 2} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-464609643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0080e976-715c-4380-b36a-86845ca5404a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de55dee2c55a4325aae7f4e39356eef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:12Z,use_quota=True,user_id='60c13bb12543406e9f62ff699c008333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Creating volume 0080e976-715c-4380-b36a-86845ca5404a {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:11 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a 2147483648 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:11 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a 2147483648 Apr 10 13:22:11 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:12 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" returned: 0 in 0.552s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:12 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8 Apr 10 13:22:12 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:12 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c" returned: 0 in 0.487s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:12 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c Apr 10 13:22:12 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:12 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a 2147483648" returned: 0 in 0.518s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:12 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a Apr 10 13:22:12 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:12 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" returned: 0 in 0.453s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-f4ff603c-a355-4fe5-a621-8ce91ac61cb8" released by "delete_volume" :: held 1.040s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Created reservations ['bb42a941-15b1-4429-bd40-c7d44db61975', '69fab1bb-c44c-434e-a96b-561a229bc55e', '77c5f3a7-4b60-4381-9d2f-496c521f492e', '716330b0-5b52-41f1-b5e4-f7ed2e2d456b'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:12 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c" returned: 0 in 0.469s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-quobyte-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c" released by "delete_volume" :: held 0.995s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:12 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:12 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Created reservations ['4f446cbc-2a87-4990-af58-34a1e46d97c1', '27619eb5-34e2-4eb3-a880-4ba02b5c41a8', 'd07b18ec-4e71-4d5f-8f67-3f0223e7b5e2', '400675f2-0745-42c8-9c3d-a4492d994f02'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:12 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:12 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:12 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a" returned: 0 in 0.465s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86098938-e96b-412a-91af-e2843b37ecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0080e976-715c-4380-b36a-86845ca5404a', 'volume_size': 2}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9852a1-ea2f-4e57-adf1-79eb750a79dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:12 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Volume volume-0080e976-715c-4380-b36a-86845ca5404a (0080e976-715c-4380-b36a-86845ca5404a): created successfully Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9852a1-ea2f-4e57-adf1-79eb750a79dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:12 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Flow 'volume_create_manager' (189c987c-5b7e-4bd5-9071-db59c8bf5fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:12 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-005ce406-52a5-47de-a12e-281be86d038f tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Created volume successfully. Apr 10 13:22:13 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.446s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:13 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Deleted volume successfully. Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7df8e180-b12e-4c8e-b634-828f15078b96 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-f4ff603c-a355-4fe5-a621-8ce91ac61cb8-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:13 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.438s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:13 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Deleted volume successfully. Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1540aa78-b519-4f82-ae4d-b8fdcb53e7e1 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-4f398cb9-5910-4c45-8e69-cfd3bdfacb1c-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Flow 'volume_create_manager' (2f5cc4db-15af-45df-91ea-bac0d050786d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebb65fd-6c22-40b8-8444-94ec78f9c606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebb65fd-6c22-40b8-8444-94ec78f9c606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1365405373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ab6264d2624b49b996a6330cb190ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:14Z,use_quota=True,user_id='c4ce775ea0904925bd457e84a154c262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c7b7db-2da1-4c17-81aa-a09bb00d1300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c7b7db-2da1-4c17-81aa-a09bb00d1300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855eed2e-68f2-4825-a617-0c009114c2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855eed2e-68f2-4825-a617-0c009114c2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5', 'volume_name': 'volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f87d0c-2d88-43d7-a43b-361eed736fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f87d0c-2d88-43d7-a43b-361eed736fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd5c542-0884-43b4-b619-8cc85ed3a344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:13 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Volume 4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5', 'volume_size': 1} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1365405373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ab6264d2624b49b996a6330cb190ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:14Z,use_quota=True,user_id='c4ce775ea0904925bd457e84a154c262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Creating volume 4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:14 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "cinder-ae066da7-4aba-415a-bf2f-34740753d7e5-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:14 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 1073741824 Apr 10 13:22:14 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-ae066da7-4aba-415a-bf2f-34740753d7e5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "cinder-quobyte-ae066da7-4aba-415a-bf2f-34740753d7e5" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-quobyte-ae066da7-4aba-415a-bf2f-34740753d7e5" acquired by "delete_volume" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[870ee12a-8bc5-40b0-b0e4-aefcfacf2a12]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:14 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5 Apr 10 13:22:14 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:14 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 1073741824" returned: 0 in 0.512s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:14 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 Apr 10 13:22:14 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:14 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5" returned: 0 in 0.488s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:14 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5 Apr 10 13:22:14 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:14 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5" returned: 0 in 0.436s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.889s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd5c542-0884-43b4-b619-8cc85ed3a344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2411c119-e9d4-40e5-b082-54d47b5b786a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Creating offline snapshot 213429f8-fb7b-4b31-b63b-9d1a127deda4 of volume 0080e976-715c-4380-b36a-86845ca5404a {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:22:15 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:15 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Volume volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 (4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5): created successfully Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2411c119-e9d4-40e5-b082-54d47b5b786a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Flow 'volume_create_manager' (2f5cc4db-15af-45df-91ea-bac0d050786d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e1e106-7cdc-4130-9035-d3620baf367d]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ae066da7-4aba-415a-bf2f-34740753d7e5" returned: 0 in 0.511s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:15 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-d3eef7e2-0f31-4c97-8018-3de8b0896bcf tempest-VolumeDependencyTests-783471176 None] Created volume successfully. Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-quobyte-ae066da7-4aba-415a-bf2f-34740753d7e5" released by "delete_volume" :: held 1.027s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Created reservations ['97afe6dd-cb77-411e-8ee5-977b185a63c4', 'b9cf6a40-eccb-4412-ac3c-5e55a74ed8e8', '29461c8d-ab58-46ff-9a84-b762bc60f8c5', '8575f24e-7719-4b39-bb89-1e1a2d5afc2a'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:15 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a Apr 10 13:22:15 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:15 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:15 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:15 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a" returned: 0 in 0.484s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 2G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:15 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 2G Apr 10 13:22:15 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:15 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:15 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Deleted volume successfully. Apr 10 13:22:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6ee8372c-15cd-4411-a18b-6433494a0bd5 tempest-VolumesListAdminTestJSON-2111517379 None] Lock "cinder-ae066da7-4aba-415a-bf2f-34740753d7e5-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:16 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 2G" returned: 0 in 0.534s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0080e976-715c-4380-b36a-86845ca5404a -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:16 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0080e976-715c-4380-b36a-86845ca5404a -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 Apr 10 13:22:16 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Flow 'volume_create_manager' (7de738da-203a-47d6-a035-e101b252443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa27c1c-bd23-4a8f-9734-d8c69bf216d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa27c1c-bd23-4a8f-9734-d8c69bf216d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1485083041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ab6264d2624b49b996a6330cb190ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:16Z,use_quota=True,user_id='c4ce775ea0904925bd457e84a154c262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5da3728-65ed-4ee7-89d4-26e65151f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5da3728-65ed-4ee7-89d4-26e65151f696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489db900-4002-492a-b8c6-47760efb79bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489db900-4002-492a-b8c6-47760efb79bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1', 'volume_name': 'volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1', 'volume_size': 1, 'source_volid': '4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5', 'source_volstatus': 'available'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae57633-1c33-4acf-bcbf-0e0e83beb72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae57633-1c33-4acf-bcbf-0e0e83beb72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f198177e-8d73-44d1-bec8-78801f20d195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:16 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Volume 0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1', 'volume_size': 1, 'source_volid': '4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5', 'source_volstatus': 'available'} Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:16 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0080e976-715c-4380-b36a-86845ca5404a -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4" returned: 0 in 0.499s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:16 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 is being set with open permissions: ugo+rw Apr 10 13:22:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:16 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 Apr 10 13:22:16 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:17 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4" returned: 0 in 0.459s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:17 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.info Apr 10 13:22:17 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:17 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.info" returned: 0 in 0.457s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:17 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.info is being set with open permissions: ugo+rw Apr 10 13:22:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:17 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.info Apr 10 13:22:17 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:18 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.info" returned: 0 in 0.468s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.031s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.609s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:18 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Cloning volume 4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 to volume 0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Creating offline snapshot e55dc671-7bf2-4422-a2e0-785462283ecf of volume 4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f45973-dc29-42cc-b889-cbac79f1e5e2]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:18 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6d3b981a-c4a0-4fbd-9936-a791a10dd1ce tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Create snapshot completed successfully Apr 10 13:22:18 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 Apr 10 13:22:18 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Acquiring lock "cinder-213429f8-fb7b-4b31-b63b-9d1a127deda4-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "cinder-213429f8-fb7b-4b31-b63b-9d1a127deda4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Acquiring lock "cinder-quobyte-0080e976-715c-4380-b36a-86845ca5404a" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "cinder-quobyte-0080e976-715c-4380-b36a-86845ca5404a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Acquiring lock "cinder-quobyte-213429f8-fb7b-4b31-b63b-9d1a127deda4" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "cinder-quobyte-213429f8-fb7b-4b31-b63b-9d1a127deda4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Deleting offline snapshot 213429f8-fb7b-4b31-b63b-9d1a127deda4 of volume 0080e976-715c-4380-b36a-86845ca5404a {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] snapshot_file for this snap is: volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0f9abb-a64d-4f2b-9772-77015d086da4]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:18 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 Apr 10 13:22:18 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:18 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5" returned: 0 in 0.578s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:18 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf 1G Apr 10 13:22:18 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:18 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4" returned: 0 in 0.569s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0080e976-715c-4380-b36a-86845ca5404a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba62c15-4a0f-4bf9-9bf3-4569e0fe6b56]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:19 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a Apr 10 13:22:19 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:19 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf 1G" returned: 0 in 0.556s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:19 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf Apr 10 13:22:19 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:19 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a" returned: 0 in 0.564s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:19 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 Apr 10 13:22:19 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:19 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf" returned: 0 in 0.490s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:19 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf is being set with open permissions: ugo+rw Apr 10 13:22:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:19 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf Apr 10 13:22:19 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:20 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4" returned: 0 in 0.534s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:20 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4 Apr 10 13:22:20 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:20 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf" returned: 0 in 0.439s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:20 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.info Apr 10 13:22:20 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:20 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a.213429f8-fb7b-4b31-b63b-9d1a127deda4" returned: 0 in 0.517s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "cinder-quobyte-213429f8-fb7b-4b31-b63b-9d1a127deda4" released by "_delete_snapshot" :: held 2.243s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "cinder-quobyte-0080e976-715c-4380-b36a-86845ca5404a" released by "delete_snapshot" :: held 2.266s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Created reservations ['58fe44cf-53d1-454b-ad3a-7cfb00cb73ed', 'a277c048-3e3f-4475-a354-d9cab1d7b5c0', '3baace3b-3458-4a91-99f1-94e3d8b33553', 'acf1c0e4-85e5-4388-b633-817e2e5e149a'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:20 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Delete snapshot completed successfully. Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ca93246b-2be6-4d96-8916-a90a69cd82a1 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "cinder-213429f8-fb7b-4b31-b63b-9d1a127deda4-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:20 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.info" returned: 0 in 0.541s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:20 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.info is being set with open permissions: ugo+rw Apr 10 13:22:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:20 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.info Apr 10 13:22:20 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:21 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.info" returned: 0 in 0.466s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-quobyte-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] snapshot: e55dc671-7bf2-4422-a2e0-785462283ecf, volume: 0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a6237c-c6ab-4a27-b371-fb5a08de259c]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:21 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf Apr 10 13:22:21 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Acquiring lock "cinder-0080e976-715c-4380-b36a-86845ca5404a-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "cinder-0080e976-715c-4380-b36a-86845ca5404a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Acquiring lock "cinder-quobyte-0080e976-715c-4380-b36a-86845ca5404a" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "cinder-quobyte-0080e976-715c-4380-b36a-86845ca5404a" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a8c51d-5b21-46c4-9721-d02efb2691af]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:21 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a Apr 10 13:22:21 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:21 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf" returned: 0 in 0.574s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[64736598-d544-41de-9436-0628e2d9f069]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:21 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 Apr 10 13:22:21 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:22 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a" returned: 0 in 0.565s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:22 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a Apr 10 13:22:22 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:22 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5" returned: 0 in 0.514s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:22 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 Apr 10 13:22:22 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_service.periodic_task [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82554) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:22 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:22 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:22 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0080e976-715c-4380-b36a-86845ca5404a" returned: 0 in 0.430s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "cinder-quobyte-0080e976-715c-4380-b36a-86845ca5404a" released by "delete_volume" :: held 1.034s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Created reservations ['779394ed-5c90-488c-ac96-d82713979e82', '2f9e31bd-926b-4003-9223-521e8dcc503f', '5af50952-13db-4a97-a65e-da8938bc2b2f', '2fb121ea-b3bb-4fa1-9f64-4240449d173c'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:22 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:22 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:23 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 1.019s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:23 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:24 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 1.276s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:24 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:24 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Deleted volume successfully. Apr 10 13:22:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-72a13759-1f84-4aa1-8546-32e8295a7870 tempest-VolumesSnapshotNegativeTestJSON-887966296 None] Lock "cinder-0080e976-715c-4380-b36a-86845ca5404a-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:24 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1" returned: 0 in 2.559s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:24 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e7dd41-309d-46a4-8d2a-94c001dd4506]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:24 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 Apr 10 13:22:24 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:25 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5" returned: 0 in 0.751s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:25 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5, size 1024.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:22:25 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Converted 1024.00 MB image at 400.02 MB/s Apr 10 13:22:25 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 is being set with open permissions: ugo+rw Apr 10 13:22:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:25 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 Apr 10 13:22:25 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:26 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1" returned: 0 in 0.557s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1" released by "_copy_volume_from_snapshot" :: held 5.008s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-quobyte-e55dc671-7bf2-4422-a2e0-785462283ecf" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-e55dc671-7bf2-4422-a2e0-785462283ecf" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Deleting offline snapshot e55dc671-7bf2-4422-a2e0-785462283ecf of volume 4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] snapshot_file for this snap is: volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77365fb-cee3-4fd4-a1b0-2e51542c45f5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Flow 'volume_create_manager' (2c2eab39-f69e-4bf7-954c-3b54d9ce201d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21338709-2310-444b-a129-ba075a5c8704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21338709-2310-444b-a129-ba075a5c8704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1506757511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9412d3-f8e5-49d0-8833-d41f7d6e54f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0d151bd87a4958830705d50ef1328b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:26Z,use_quota=True,user_id='5c901027085b40648842af750bfc0b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451fce89-8bab-49a5-b2bf-882ffd524c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf Apr 10 13:22:26 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451fce89-8bab-49a5-b2bf-882ffd524c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766f1062-fd0d-4602-9680-534c0a2f112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766f1062-fd0d-4602-9680-534c0a2f112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9412d3-f8e5-49d0-8833-d41f7d6e54f4', 'volume_name': 'volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2c4262-a30b-41e6-9798-5c14c6c5e406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2c4262-a30b-41e6-9798-5c14c6c5e406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdf8d6f-c967-479c-9a76-5644d8306d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Volume 5b9412d3-f8e5-49d0-8833-d41f7d6e54f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4', 'volume_size': 1} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Flow 'volume_create_manager' (b616d3b3-b777-4ca2-bbab-92a910397808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7193d469-298b-46f6-989c-8bfbeab5b13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7193d469-298b-46f6-989c-8bfbeab5b13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-829909049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4158ef7c-0610-46b7-a551-6abb8304ac1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0d151bd87a4958830705d50ef1328b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:26Z,use_quota=True,user_id='5c901027085b40648842af750bfc0b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9da127-836e-4746-bf03-dc4cd164dbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9da127-836e-4746-bf03-dc4cd164dbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4613ab66-4830-4edb-be32-c70749041b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4613ab66-4830-4edb-be32-c70749041b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4158ef7c-0610-46b7-a551-6abb8304ac1b', 'volume_name': 'volume-4158ef7c-0610-46b7-a551-6abb8304ac1b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32df44a5-94f3-4c22-8a4b-bb6951343b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32df44a5-94f3-4c22-8a4b-bb6951343b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd300281-8b0f-450c-8b70-843da3c00feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Volume 4158ef7c-0610-46b7-a551-6abb8304ac1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4158ef7c-0610-46b7-a551-6abb8304ac1b', 'volume_size': 1} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Flow 'volume_create_manager' (cd4ed00a-0440-4e52-aa54-6ca0e1696e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96f5615-4bf7-4f75-b125-7555fc34a956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96f5615-4bf7-4f75-b125-7555fc34a956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53881304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0d151bd87a4958830705d50ef1328b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:27Z,use_quota=True,user_id='5c901027085b40648842af750bfc0b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c332ac-4b01-44b1-bc07-f43e03e839a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c332ac-4b01-44b1-bc07-f43e03e839a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523c4748-183f-4806-ae50-03f0465d4337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523c4748-183f-4806-ae50-03f0465d4337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb', 'volume_name': 'volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363b2b40-2b45-4275-916f-fbb206e00d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363b2b40-2b45-4275-916f-fbb206e00d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadd6f8e-3ca0-4f73-ab8a-4c33855dda70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:26 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Volume 2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb', 'volume_size': 1} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:26 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf" returned: 0 in 0.626s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b2b871-69d4-422c-87a3-4eded4ca92cd]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:26 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Flow 'volume_create_manager' (ca110083-ea06-4263-8448-570b236082c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae19191-5dec-44dd-8e61-14b030488cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae19191-5dec-44dd-8e61-14b030488cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623150621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047b139f-2e3a-4c63-9242-12398c1bb498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0d151bd87a4958830705d50ef1328b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:27Z,use_quota=True,user_id='5c901027085b40648842af750bfc0b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c645355b-5029-4f99-a5ea-872ae22df1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c645355b-5029-4f99-a5ea-872ae22df1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60126ac5-80af-4148-81bb-a01e370299ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60126ac5-80af-4148-81bb-a01e370299ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '047b139f-2e3a-4c63-9242-12398c1bb498', 'volume_name': 'volume-047b139f-2e3a-4c63-9242-12398c1bb498', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c25ba37-6385-48ad-b3c3-b2fc2eb6f7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c25ba37-6385-48ad-b3c3-b2fc2eb6f7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992b586d-d460-4f0a-906a-048b9e7ee63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:27 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Volume 047b139f-2e3a-4c63-9242-12398c1bb498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-047b139f-2e3a-4c63-9242-12398c1bb498', 'volume_size': 1} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:27 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 Apr 10 13:22:27 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Flow 'volume_create_manager' (b691fecf-beef-4198-87d2-aa285fa09b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376c8eb6-17e4-4c6e-b70a-01ddb0506aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376c8eb6-17e4-4c6e-b70a-01ddb0506aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1133101153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9eb7cb-1c9f-4f25-af50-0a413d3b0874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0d151bd87a4958830705d50ef1328b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:27Z,use_quota=True,user_id='5c901027085b40648842af750bfc0b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c655ed15-251d-4298-8e39-6033ca5cce8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c655ed15-251d-4298-8e39-6033ca5cce8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af32762c-831b-4d42-ac57-3726613f5b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af32762c-831b-4d42-ac57-3726613f5b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab9eb7cb-1c9f-4f25-af50-0a413d3b0874', 'volume_name': 'volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8e9798-b5dc-41d7-8b86-39cb543b2375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8e9798-b5dc-41d7-8b86-39cb543b2375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dff814b2-3450-4fb2-aa6a-95d56829353a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:27 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Volume ab9eb7cb-1c9f-4f25-af50-0a413d3b0874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874', 'volume_size': 1} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:27 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5" returned: 0 in 0.655s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:27 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf Apr 10 13:22:27 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:28 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf" returned: 0 in 0.491s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:28 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf Apr 10 13:22:28 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:28 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5.e55dc671-7bf2-4422-a2e0-785462283ecf" returned: 0 in 0.441s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-e55dc671-7bf2-4422-a2e0-785462283ecf" released by "_delete_snapshot" :: held 2.264s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.514s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.173s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1506757511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9412d3-f8e5-49d0-8833-d41f7d6e54f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0d151bd87a4958830705d50ef1328b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:26Z,use_quota=True,user_id='5c901027085b40648842af750bfc0b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Creating volume 5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:28 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f198177e-8d73-44d1-bec8-78801f20d195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1', 'volume_size': 1, 'source_volid': '4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5', 'source_volstatus': 'available'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab27b186-ac1b-4dba-a22a-396478952c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:28 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 1073741824 Apr 10 13:22:28 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:28 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Volume volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 (0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1): created successfully Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab27b186-ac1b-4dba-a22a-396478952c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Flow 'volume_create_manager' (7de738da-203a-47d6-a035-e101b252443c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:28 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b034aab7-746e-4417-b1a3-034bc66262a1 tempest-VolumeDependencyTests-783471176 None] Created volume successfully. Apr 10 13:22:29 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 1073741824" returned: 0 in 0.523s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:29 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 Apr 10 13:22:29 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-quobyte-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaae7f2-5289-4169-ab3a-8d7dc7bac3a3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:29 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 Apr 10 13:22:29 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:29 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4" returned: 0 in 0.528s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.082s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-829909049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4158ef7c-0610-46b7-a551-6abb8304ac1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0d151bd87a4958830705d50ef1328b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:26Z,use_quota=True,user_id='5c901027085b40648842af750bfc0b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Creating volume 4158ef7c-0610-46b7-a551-6abb8304ac1b {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:29 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdf8d6f-c967-479c-9a76-5644d8306d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:29 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b 1073741824 Apr 10 13:22:29 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b040262f-a153-4891-952e-e6d4ef6d8600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:29 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Volume volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 (5b9412d3-f8e5-49d0-8833-d41f7d6e54f4): created successfully Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b040262f-a153-4891-952e-e6d4ef6d8600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Flow 'volume_create_manager' (2c2eab39-f69e-4bf7-954c-3b54d9ce201d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:29 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ce05898b-793a-48aa-9487-bd68b0923e66 tempest-CreateVolumesFromImageTest-137311530 None] Created volume successfully. Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Flow 'volume_create_manager' (20357e23-bf08-4e11-abb1-5604d1e3365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3459d4-72ee-4674-b060-977f86b4f3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3459d4-72ee-4674-b060-977f86b4f3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173466668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59a13e1-fc96-4c20-a169-9624f61c6451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b9237c5cf747168693ec00b212672d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:30Z,use_quota=True,user_id='b0b203f0d41c41c9bbb719ec863084f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac872689-bb2c-40fb-b8ec-c6254755995d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac872689-bb2c-40fb-b8ec-c6254755995d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5beb298e-43c6-4818-949d-db1663f057ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5beb298e-43c6-4818-949d-db1663f057ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a59a13e1-fc96-4c20-a169-9624f61c6451', 'volume_name': 'volume-a59a13e1-fc96-4c20-a169-9624f61c6451', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afc40ac-16bf-43e8-8fbb-b03cfba9d783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afc40ac-16bf-43e8-8fbb-b03cfba9d783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a56284e-8237-48b4-9b9f-47ea18bcfa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:29 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Volume a59a13e1-fc96-4c20-a169-9624f61c6451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a59a13e1-fc96-4c20-a169-9624f61c6451', 'volume_size': 1} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:29 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5" returned: 0 in 0.580s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:29 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5 Apr 10 13:22:29 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:30 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b 1073741824" returned: 0 in 0.496s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:30 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b Apr 10 13:22:30 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:30 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5" returned: 0 in 0.431s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5" released by "delete_volume" :: held 1.044s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Created reservations ['115d4a28-24a5-480c-b58f-9c8b879272ca', '0d4ec561-5699-42ca-bdf6-54826c158bd4', '956ee259-c94a-405b-823a-75a69b15e7be', 'e93ed029-bcca-4086-893c-e76fa0635c40'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:30 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:30 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:30 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b" returned: 0 in 0.449s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.855s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53881304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0d151bd87a4958830705d50ef1328b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:27Z,use_quota=True,user_id='5c901027085b40648842af750bfc0b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Creating volume 2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:30 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd300281-8b0f-450c-8b70-843da3c00feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4158ef7c-0610-46b7-a551-6abb8304ac1b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747a3a9d-1e8c-40d2-b906-b849296ebf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:30 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb 1073741824 Apr 10 13:22:30 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:30 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Volume volume-4158ef7c-0610-46b7-a551-6abb8304ac1b (4158ef7c-0610-46b7-a551-6abb8304ac1b): created successfully Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747a3a9d-1e8c-40d2-b906-b849296ebf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Flow 'volume_create_manager' (b616d3b3-b777-4ca2-bbab-92a910397808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:30 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2bab4133-27e5-4981-953c-e114c8d4be6b tempest-CreateVolumesFromImageTest-137311530 None] Created volume successfully. Apr 10 13:22:30 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.413s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:30 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Deleted volume successfully. Apr 10 13:22:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3771c5ab-8b9f-4c2f-b871-c962e11fd678 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-4576fe17-3d6b-4fbd-a6a2-695b9c0e05d5-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:31 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb 1073741824" returned: 0 in 0.497s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:31 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb Apr 10 13:22:31 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-quobyte-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e858113-1bd8-4b53-9c97-545f576d342a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:31 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 Apr 10 13:22:31 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:31 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb" returned: 0 in 0.458s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.563s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623150621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047b139f-2e3a-4c63-9242-12398c1bb498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0d151bd87a4958830705d50ef1328b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:27Z,use_quota=True,user_id='5c901027085b40648842af750bfc0b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Creating volume 047b139f-2e3a-4c63-9242-12398c1bb498 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:31 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadd6f8e-3ca0-4f73-ab8a-4c33855dda70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:31 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498 1073741824 Apr 10 13:22:31 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e01a722-5dac-403a-9f56-46c425d5947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:31 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Volume volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb (2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb): created successfully Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e01a722-5dac-403a-9f56-46c425d5947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Flow 'volume_create_manager' (cd4ed00a-0440-4e52-aa54-6ca0e1696e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:31 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-405746fc-71fd-4ec7-b7a9-4d13d5647adf tempest-CreateVolumesFromImageTest-137311530 None] Created volume successfully. Apr 10 13:22:31 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1" returned: 0 in 0.501s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:31 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1 Apr 10 13:22:31 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:32 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498 1073741824" returned: 0 in 0.494s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:32 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498 Apr 10 13:22:32 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:32 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1" returned: 0 in 0.416s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1" released by "delete_volume" :: held 0.942s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Created reservations ['8dc76ce1-0d08-4a9d-8f46-adb4905f6bac', 'cf4fe527-f80b-4d04-a8bd-c2e267ab6798', '935618d2-9f78-4a9e-9e34-74b9f535b765', 'cfc13215-16bd-41fc-ba22-fd8eee47c518'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:32 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:32 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-5acfafef-dbc5-42fd-90b1-8d226b416fef-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-5acfafef-dbc5-42fd-90b1-8d226b416fef-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "cinder-quobyte-5acfafef-dbc5-42fd-90b1-8d226b416fef" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-5acfafef-dbc5-42fd-90b1-8d226b416fef" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde1f167-2c27-4167-bed7-ec4caf9d5083]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:32 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498" returned: 0 in 0.480s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.414s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1133101153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9eb7cb-1c9f-4f25-af50-0a413d3b0874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0d151bd87a4958830705d50ef1328b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:27Z,use_quota=True,user_id='5c901027085b40648842af750bfc0b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Creating volume ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:32 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992b586d-d460-4f0a-906a-048b9e7ee63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047b139f-2e3a-4c63-9242-12398c1bb498', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8897e40b-68d9-460a-81f2-c81e994da003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:32 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 1073741824 Apr 10 13:22:32 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Volume volume-047b139f-2e3a-4c63-9242-12398c1bb498 (047b139f-2e3a-4c63-9242-12398c1bb498): created successfully Apr 10 13:22:32 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8897e40b-68d9-460a-81f2-c81e994da003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Flow 'volume_create_manager' (ca110083-ea06-4263-8448-570b236082c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:32 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-4410db53-31b6-4ac5-92d6-0ad5acbb9ff7 tempest-CreateVolumesFromImageTest-137311530 None] Created volume successfully. Apr 10 13:22:32 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef Apr 10 13:22:32 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:32 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.489s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:32 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Deleted volume successfully. Apr 10 13:22:32 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-df8fa972-0292-433a-9635-d3b1c194bce0 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-0e4e6cc6-7c59-46d3-967c-5cbd7279a9b1-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:33 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef" returned: 0 in 0.507s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:33 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef Apr 10 13:22:33 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:33 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 1073741824" returned: 0 in 0.517s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:33 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 Apr 10 13:22:33 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:33 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5acfafef-dbc5-42fd-90b1-8d226b416fef" returned: 0 in 0.406s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-quobyte-5acfafef-dbc5-42fd-90b1-8d226b416fef" released by "delete_volume" :: held 0.938s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Created reservations ['f8c1cb8b-c054-43ec-8931-70e74ce1a698', 'b1ad7fde-6977-41f1-951d-65448d352dc1', 'b8a057e6-540e-4b34-b0c1-2842ed772a77', '6d4a8210-84fb-4725-b25f-3a6358b711e6'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:33 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874" returned: 0 in 0.424s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.763s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173466668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59a13e1-fc96-4c20-a169-9624f61c6451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b9237c5cf747168693ec00b212672d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:30Z,use_quota=True,user_id='b0b203f0d41c41c9bbb719ec863084f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Creating volume a59a13e1-fc96-4c20-a169-9624f61c6451 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:33 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dff814b2-3450-4fb2-aa6a-95d56829353a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528461b3-fe12-4ed6-b8e7-dc4541e5e8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:33 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 1073741824 Apr 10 13:22:33 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:33 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Volume volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 (ab9eb7cb-1c9f-4f25-af50-0a413d3b0874): created successfully Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528461b3-fe12-4ed6-b8e7-dc4541e5e8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Flow 'volume_create_manager' (b691fecf-beef-4198-87d2-aa285fa09b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:33 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:33 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:33 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-837dcc40-4da5-4338-9732-895625c8c2a0 tempest-CreateVolumesFromImageTest-137311530 None] Created volume successfully. Apr 10 13:22:34 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.511s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:34 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Deleted volume successfully. Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5a5bce68-5968-4970-a789-f70e276dc110 tempest-VolumeDependencyTests-783471176 None] Lock "cinder-5acfafef-dbc5-42fd-90b1-8d226b416fef-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:34 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 1073741824" returned: 0 in 0.627s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:34 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 Apr 10 13:22:34 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:34 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451" returned: 0 in 0.499s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "cinder-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a56284e-8237-48b4-9b9f-47ea18bcfa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59a13e1-fc96-4c20-a169-9624f61c6451', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7f9471-9030-4ebd-9cee-3b6ffdf30a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:34 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Volume volume-a59a13e1-fc96-4c20-a169-9624f61c6451 (a59a13e1-fc96-4c20-a169-9624f61c6451): created successfully Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac7f9471-9030-4ebd-9cee-3b6ffdf30a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Flow 'volume_create_manager' (20357e23-bf08-4e11-abb1-5604d1e3365d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:34 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-d0431c23-6e87-4329-bf17-143fe1774d60 tempest-VolumesActionsTest-233834405 None] Created volume successfully. Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "cinder-quobyte-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-quobyte-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a74c2c4-20ef-469f-9680-42120ad461c8]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:34 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 Apr 10 13:22:34 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:35 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874" returned: 0 in 0.648s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:35 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874 Apr 10 13:22:35 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Flow 'volume_create_manager' (c2c42c72-55f8-450a-bc65-d821f9dcb916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b3d035-1c87-4fd9-a7e1-436415dc94e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b3d035-1c87-4fd9-a7e1-436415dc94e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d25dcc-2905-493c-bde5-c3445d768840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6dd7990752c4ba791b6a53fa39e190a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:35Z,use_quota=True,user_id='b46f0be0634c4cefbbb24e6890950224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67787ae7-f2c3-4d5b-abdb-e6993cdb1afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67787ae7-f2c3-4d5b-abdb-e6993cdb1afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239d3a9a-2fab-44fb-8a27-c2c3e28b8db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239d3a9a-2fab-44fb-8a27-c2c3e28b8db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d25dcc-2905-493c-bde5-c3445d768840', 'volume_name': 'volume-23d25dcc-2905-493c-bde5-c3445d768840', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92407c35-4fda-46e3-8d73-e528fb399ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92407c35-4fda-46e3-8d73-e528fb399ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d330a240-5ef1-4b01-a658-dfeca6372364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:35 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Volume 23d25dcc-2905-493c-bde5-c3445d768840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d25dcc-2905-493c-bde5-c3445d768840', 'volume_size': 1} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d25dcc-2905-493c-bde5-c3445d768840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6dd7990752c4ba791b6a53fa39e190a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:35Z,use_quota=True,user_id='b46f0be0634c4cefbbb24e6890950224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Creating volume 23d25dcc-2905-493c-bde5-c3445d768840 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:35 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:35 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840 1073741824 Apr 10 13:22:35 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:35 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874" returned: 0 in 0.410s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-quobyte-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874" released by "delete_volume" :: held 1.083s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:35 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Created reservations ['fcfaec44-5e57-42d4-8e27-b1b47ceb13ef', 'b8501bb4-a39d-4b3e-a53b-93fd0042a58e', 'cc9c5eaf-2df7-499a-a3bd-7b20017aa3b2', '70dcbe12-625e-4cb1-8e9b-809c603af238'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:36 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:36 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:36 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840 1073741824" returned: 0 in 0.584s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:36 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840 Apr 10 13:22:36 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:36 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.431s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:36 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Deleted volume successfully. Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-190e7b8c-8159-4173-bb1d-dc2512df1618 tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-ab9eb7cb-1c9f-4f25-af50-0a413d3b0874-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:36 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840" returned: 0 in 0.414s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d330a240-5ef1-4b01-a658-dfeca6372364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d25dcc-2905-493c-bde5-c3445d768840', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f30680-679d-4eeb-946a-511a2183c499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:36 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Volume volume-23d25dcc-2905-493c-bde5-c3445d768840 (23d25dcc-2905-493c-bde5-c3445d768840): created successfully Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f30680-679d-4eeb-946a-511a2183c499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Flow 'volume_create_manager' (c2c42c72-55f8-450a-bc65-d821f9dcb916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:36 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-af8e510b-c484-4885-b33f-0dcbfe8e79fe tempest-CinderUnicodeTest-1900841084 None] Created volume successfully. Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "cinder-047b139f-2e3a-4c63-9242-12398c1bb498-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-047b139f-2e3a-4c63-9242-12398c1bb498-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "cinder-quobyte-047b139f-2e3a-4c63-9242-12398c1bb498" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-quobyte-047b139f-2e3a-4c63-9242-12398c1bb498" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce47098-a57c-4c62-baa4-925b8f94a23d]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:37 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498 Apr 10 13:22:37 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:37 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498" returned: 0 in 0.472s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:37 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498 Apr 10 13:22:37 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:37 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-047b139f-2e3a-4c63-9242-12398c1bb498" returned: 0 in 0.470s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:37 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-quobyte-047b139f-2e3a-4c63-9242-12398c1bb498" released by "delete_volume" :: held 0.966s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:37 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:22:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Flow 'volume_create_manager' (e3e2483e-8456-4827-9790-2c0d5d849a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226ea8f3-18e7-44fa-bdda-80eddd80eff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226ea8f3-18e7-44fa-bdda-80eddd80eff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1903588443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbfa8a22-9023-4ef5-90ad-3de65b822b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6dd7990752c4ba791b6a53fa39e190a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:38Z,use_quota=True,user_id='b46f0be0634c4cefbbb24e6890950224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca229ec-97f6-446f-a19d-9f4d361068d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca229ec-97f6-446f-a19d-9f4d361068d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111b49bf-f7d1-43a5-b0eb-03a564d824d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111b49bf-f7d1-43a5-b0eb-03a564d824d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbfa8a22-9023-4ef5-90ad-3de65b822b94', 'volume_name': 'volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c2db90-cccc-45b8-86b5-c5b60fb522a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c2db90-cccc-45b8-86b5-c5b60fb522a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3794dc87-f59a-4c81-9139-73a1374aa280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:38 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Volume cbfa8a22-9023-4ef5-90ad-3de65b822b94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94', 'volume_size': 1} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:22:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1903588443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbfa8a22-9023-4ef5-90ad-3de65b822b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6dd7990752c4ba791b6a53fa39e190a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:22:38Z,use_quota=True,user_id='b46f0be0634c4cefbbb24e6890950224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Creating volume cbfa8a22-9023-4ef5-90ad-3de65b822b94 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:22:38 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Created reservations ['2b4df73b-5f95-42e0-ade7-8cedb5b8a913', '4a51e1b4-5636-4c32-b08b-93ade5bb2d60', '464a9495-ce08-4809-aa80-07262ffc735d', '06f08282-2ebf-442f-aeae-bc35982d3c70'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:38 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 1073741824 Apr 10 13:22:38 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:38 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:38 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:38 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 1073741824" returned: 0 in 0.486s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:38 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.433s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:38 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Deleted volume successfully. Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1da1d64b-4f80-43a5-9d1e-7665c5d7eb9a tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-047b139f-2e3a-4c63-9242-12398c1bb498-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:38 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 Apr 10 13:22:38 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:39 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94" returned: 0 in 0.444s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3794dc87-f59a-4c81-9139-73a1374aa280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf02bb5-7dbd-49f0-9197-f13739d4227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:22:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Volume volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 (cbfa8a22-9023-4ef5-90ad-3de65b822b94): created successfully Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf02bb5-7dbd-49f0-9197-f13739d4227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Flow 'volume_create_manager' (e3e2483e-8456-4827-9790-2c0d5d849a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:22:39 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-e070a934-1bec-4238-bd18-8cf5a3311659 tempest-CinderUnicodeTest-1900841084 None] Created volume successfully. Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "cinder-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "cinder-quobyte-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-quobyte-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb" acquired by "delete_volume" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ccaeda-0afd-48cc-ac22-0b0a3f3c52bf]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:39 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb Apr 10 13:22:39 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:39 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb" returned: 0 in 0.468s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:39 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb Apr 10 13:22:39 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:40 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb" returned: 0 in 0.444s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-quobyte-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb" released by "delete_volume" :: held 0.943s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Created reservations ['9a4ac98e-ec81-4b78-b50c-de483e5ec473', 'ec401114-cc5d-4ca5-a45b-aadc9be73546', 'e1c3e69f-fd3f-490d-bae6-26102a612884', 'fd8bbc3e-e064-49a5-b11c-7322ffb9051c'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:40 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:40 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "cinder-4158ef7c-0610-46b7-a551-6abb8304ac1b-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-4158ef7c-0610-46b7-a551-6abb8304ac1b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "cinder-quobyte-4158ef7c-0610-46b7-a551-6abb8304ac1b" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-quobyte-4158ef7c-0610-46b7-a551-6abb8304ac1b" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc7e32f-7cf8-4835-b8ec-575f1650289e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Creating offline snapshot 3156c1f5-7c18-4dc0-82fe-677427acdd93 of volume cbfa8a22-9023-4ef5-90ad-3de65b822b94 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ab9223-5566-436e-82f6-435907687c79]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:40 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b Apr 10 13:22:40 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:40 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 Apr 10 13:22:40 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:40 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.540s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:40 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Deleted volume successfully. Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-548ff141-eba9-43be-88f4-f33721afd8d1 tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-2ee14cf0-4be9-46ed-825f-0e77e9c4c8cb-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:40 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b" returned: 0 in 0.551s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:40 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b Apr 10 13:22:40 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:41 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94" returned: 0 in 0.648s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:41 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 1G Apr 10 13:22:41 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:41 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4158ef7c-0610-46b7-a551-6abb8304ac1b" returned: 0 in 0.532s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-quobyte-4158ef7c-0610-46b7-a551-6abb8304ac1b" released by "delete_volume" :: held 1.108s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Created reservations ['ed8ed365-8ab0-4951-94ed-4cd6e2bb82ea', 'd8dd0e5c-ea18-4eb5-90ea-011f127015c7', 'e4350fe1-3a14-440d-b1fe-1e6b1799d3b1', 'ee96a147-f09f-441c-aa19-48f29d836de2'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:41 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:41 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:41 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 1G" returned: 0 in 0.557s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:41 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 Apr 10 13:22:41 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:41 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.425s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Deleted volume successfully. Apr 10 13:22:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0cfae713-09d4-45f1-91e2-ce6cb6e5075b tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-4158ef7c-0610-46b7-a551-6abb8304ac1b-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:42 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93" returned: 0 in 0.483s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:42 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 is being set with open permissions: ugo+rw Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:42 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 Apr 10 13:22:42 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "cinder-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "cinder-quobyte-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-quobyte-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad492916-c534-4bf0-bec0-52279b00e168]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:42 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 Apr 10 13:22:42 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:42 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93" returned: 0 in 0.508s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:42 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.info Apr 10 13:22:42 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:42 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4" returned: 0 in 0.477s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:42 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4 Apr 10 13:22:42 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:43 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.info" returned: 0 in 0.428s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:43 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.info is being set with open permissions: ugo+rw Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:43 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.info Apr 10 13:22:43 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:43 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4" returned: 0 in 0.432s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-quobyte-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4" released by "delete_volume" :: held 0.938s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Created reservations ['6ed7a9ff-cf9c-4a72-ac04-7beab8a1abb2', '0bbfe217-ec77-4158-9cdd-2073a2fe8178', '708d0444-a8e8-48c5-b310-95f635a7e6c2', '5bf33f95-3f24-4682-982c-e7de87a280b2'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:43 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.info" returned: 0 in 0.457s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.155s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:43 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:43 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:43 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0608e9c1-4ac3-47ae-805b-3428caeca6da tempest-CinderUnicodeTest-1900841084 None] Create snapshot completed successfully Apr 10 13:22:43 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.467s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:43 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Deleted volume successfully. Apr 10 13:22:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ce1ba86e-107b-4aa9-bc2c-977a4fb8545c tempest-CreateVolumesFromImageTest-137311530 None] Lock "cinder-5b9412d3-f8e5-49d0-8833-d41f7d6e54f4-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "cinder-3156c1f5-7c18-4dc0-82fe-677427acdd93-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-3156c1f5-7c18-4dc0-82fe-677427acdd93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "cinder-quobyte-cbfa8a22-9023-4ef5-90ad-3de65b822b94" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-quobyte-cbfa8a22-9023-4ef5-90ad-3de65b822b94" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "cinder-quobyte-3156c1f5-7c18-4dc0-82fe-677427acdd93" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-quobyte-3156c1f5-7c18-4dc0-82fe-677427acdd93" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Deleting offline snapshot 3156c1f5-7c18-4dc0-82fe-677427acdd93 of volume cbfa8a22-9023-4ef5-90ad-3de65b822b94 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:22:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] snapshot_file for this snap is: volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:22:44 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd60529-61a4-4260-92dd-9e69d165f535]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:44 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 Apr 10 13:22:44 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:45 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93" returned: 0 in 0.507s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:22:45 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31ad7bb-6f79-480f-a8e3-dc9641133c75]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:45 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 Apr 10 13:22:45 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:45 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94" returned: 0 in 0.478s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:45 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 Apr 10 13:22:45 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:46 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93" returned: 0 in 0.579s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:46 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93 Apr 10 13:22:46 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:46 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94.3156c1f5-7c18-4dc0-82fe-677427acdd93" returned: 0 in 0.509s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:46 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-quobyte-3156c1f5-7c18-4dc0-82fe-677427acdd93" released by "_delete_snapshot" :: held 2.130s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:46 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-quobyte-cbfa8a22-9023-4ef5-90ad-3de65b822b94" released by "delete_snapshot" :: held 2.143s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:46 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Created reservations ['7f4abae1-60ed-480e-856d-3ead560dd6a8', '200a7abf-04d9-497d-b57a-b901564d952a', '34eea9d0-e457-4784-885d-9301cd68d259', '8a11d63f-5235-4763-8821-6dbc0484668c'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:46 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Delete snapshot completed successfully. Apr 10 13:22:46 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3976045e-6d7d-49b4-9992-85d4bc785d94 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-3156c1f5-7c18-4dc0-82fe-677427acdd93-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "cinder-cbfa8a22-9023-4ef5-90ad-3de65b822b94-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-cbfa8a22-9023-4ef5-90ad-3de65b822b94-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "cinder-quobyte-cbfa8a22-9023-4ef5-90ad-3de65b822b94" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-quobyte-cbfa8a22-9023-4ef5-90ad-3de65b822b94" acquired by "delete_volume" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:47 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e69fb-189f-4b7f-a7cd-2a88376cac5c]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:47 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 Apr 10 13:22:47 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:48 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94" returned: 0 in 0.506s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:48 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94 Apr 10 13:22:48 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2a63d037-b763-49ec-94c8-28a30f23c9d7 tempest-VolumesActionsTest-233834405 None] Acquiring lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451" by "attach_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2a63d037-b763-49ec-94c8-28a30f23c9d7 tempest-VolumesActionsTest-233834405 None] Lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451" acquired by "attach_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:48 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2a63d037-b763-49ec-94c8-28a30f23c9d7 tempest-VolumesActionsTest-233834405 None] Attaching volume a59a13e1-fc96-4c20-a169-9624f61c6451 to instance 5e659ad8-9c14-463d-8e07-ea6cf4a97e58 at mountpoint /dev/vdb on host None. Apr 10 13:22:48 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2a63d037-b763-49ec-94c8-28a30f23c9d7 tempest-VolumesActionsTest-233834405 None] Attach volume completed successfully. Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2a63d037-b763-49ec-94c8-28a30f23c9d7 tempest-VolumesActionsTest-233834405 None] Lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451" released by "attach_volume" :: held 0.069s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:48 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cbfa8a22-9023-4ef5-90ad-3de65b822b94" returned: 0 in 0.491s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-quobyte-cbfa8a22-9023-4ef5-90ad-3de65b822b94" released by "delete_volume" :: held 1.034s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Created reservations ['f14b89d7-533d-4c56-92ca-1ced5d5fd3df', '96137af8-5c6e-4781-95c9-6da78d232688', 'b891818a-6f4b-4013-9171-356cc120db63', 'a4607211-7882-4c67-8415-1a1c74d96291'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:48 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:48 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9c724c1b-df7f-4786-ad6a-31dfe118a713 tempest-VolumesActionsTest-233834405 None] Acquiring lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451-detach_volume" by "detach_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9c724c1b-df7f-4786-ad6a-31dfe118a713 tempest-VolumesActionsTest-233834405 None] Lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:49 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9c724c1b-df7f-4786-ad6a-31dfe118a713 tempest-VolumesActionsTest-233834405 None] Detaching volume a59a13e1-fc96-4c20-a169-9624f61c6451 from instance 5e659ad8-9c14-463d-8e07-ea6cf4a97e58. Apr 10 13:22:49 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9c724c1b-df7f-4786-ad6a-31dfe118a713 tempest-VolumesActionsTest-233834405 None] Detach volume completed successfully. Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9c724c1b-df7f-4786-ad6a-31dfe118a713 tempest-VolumesActionsTest-233834405 None] Lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:49 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.437s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:49 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Deleted volume successfully. Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0b47cf54-3379-4a3a-80a3-c8990d3b9963 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-cbfa8a22-9023-4ef5-90ad-3de65b822b94-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "cinder-23d25dcc-2905-493c-bde5-c3445d768840-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-23d25dcc-2905-493c-bde5-c3445d768840-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "cinder-quobyte-23d25dcc-2905-493c-bde5-c3445d768840" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-quobyte-23d25dcc-2905-493c-bde5-c3445d768840" acquired by "delete_volume" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a096fa-6d41-4bab-9d9f-4ee94f897779]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:22:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:49 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840 Apr 10 13:22:49 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:50 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840" returned: 0 in 0.532s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:50 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840 Apr 10 13:22:50 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:50 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-23d25dcc-2905-493c-bde5-c3445d768840" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-quobyte-23d25dcc-2905-493c-bde5-c3445d768840" released by "delete_volume" :: held 0.989s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Created reservations ['d2f96f5e-e21b-4d3b-9986-a0a720d4a3db', '0b7fb1c0-2c43-4ab0-964a-8ae78ed68740', '0337df16-7687-4792-9160-a1f396fee00b', 'b80e3789-5cf6-43cb-b67d-5bd87cf3e10c'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:22:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:22:50 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:22:50 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:22:51 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 10 13:22:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.456s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:22:51 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:22:51 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Deleted volume successfully. Apr 10 13:22:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-fa551a56-e660-4fc9-b7fb-3f5cf91cdaa8 tempest-CinderUnicodeTest-1900841084 None] Lock "cinder-23d25dcc-2905-493c-bde5-c3445d768840-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:23:00 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:DELETE=17,cinder:SELECT=143,cinder:UPDATE=184,cinder:INSERT=54 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:23:01 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:UPDATE=220,cinder:SELECT=150,cinder:INSERT=48,cinder:DELETE=15 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:23:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ba86ad32-6862-4b7a-a1f1-f704a65a0233 tempest-VolumesActionsTest-233834405 None] Acquiring lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451" by "attach_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:23:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ba86ad32-6862-4b7a-a1f1-f704a65a0233 tempest-VolumesActionsTest-233834405 None] Lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451" acquired by "attach_volume" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:23:09 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ba86ad32-6862-4b7a-a1f1-f704a65a0233 tempest-VolumesActionsTest-233834405 None] Attaching volume a59a13e1-fc96-4c20-a169-9624f61c6451 to instance f20df423-3a6d-4b11-a142-ab3fabe0a010 at mountpoint /dev/vdb on host None. Apr 10 13:23:09 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ba86ad32-6862-4b7a-a1f1-f704a65a0233 tempest-VolumesActionsTest-233834405 None] Attach volume completed successfully. Apr 10 13:23:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ba86ad32-6862-4b7a-a1f1-f704a65a0233 tempest-VolumesActionsTest-233834405 None] Lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451" released by "attach_volume" :: held 0.053s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:23:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-dc467a95-343c-4bd2-9791-dcff98563b3d tempest-VolumesActionsTest-233834405 None] Acquiring lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451-detach_volume" by "detach_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:23:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-dc467a95-343c-4bd2-9791-dcff98563b3d tempest-VolumesActionsTest-233834405 None] Lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:23:09 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-dc467a95-343c-4bd2-9791-dcff98563b3d tempest-VolumesActionsTest-233834405 None] Detaching volume a59a13e1-fc96-4c20-a169-9624f61c6451 from instance f20df423-3a6d-4b11-a142-ab3fabe0a010. Apr 10 13:23:09 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-dc467a95-343c-4bd2-9791-dcff98563b3d tempest-VolumesActionsTest-233834405 None] Detach volume completed successfully. Apr 10 13:23:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-dc467a95-343c-4bd2-9791-dcff98563b3d tempest-VolumesActionsTest-233834405 None] Lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:23:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:19 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a07b39-3c25-47c7-8cb6-70c9a5e7d80e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:19 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 Apr 10 13:23:19 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:20 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451" returned: 0 in 0.474s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:20 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff722f3-100a-4958-a27b-5c820e485178]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:20 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 Apr 10 13:23:20 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:20 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451" returned: 0 in 0.456s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.22756c89-99bd-46c4-82f0-fb374259ccd13e9fi0uz.img {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:20 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.22756c89-99bd-46c4-82f0-fb374259ccd13e9fi0uz.img Apr 10 13:23:20 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:22 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.22756c89-99bd-46c4-82f0-fb374259ccd13e9fi0uz.img" returned: 0 in 1.849s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[258ed35d-15ae-4296-832f-a914d9f53c64]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:22 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 Apr 10 13:23:22 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG oslo_service.periodic_task [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82554) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:22 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:23:22 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:22 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.403s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:23:22 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451" returned: 0 in 0.615s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:22 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.22756c89-99bd-46c4-82f0-fb374259ccd13e9fi0uz.img {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:23:22 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Converted 1024.00 MB image at 553.53 MB/s Apr 10 13:23:23 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] 22756c89-99bd-46c4-82f0-fb374259ccd1 was raw, no need to convert to raw {{(pid=82554) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 10 13:23:24 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:23:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.883s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Uploaded volume to glance image-id: 22756c89-99bd-46c4-82f0-fb374259ccd1. {{(pid=82554) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 13:23:32 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3be53fae-4c84-4273-a525-fbcf1300c495 tempest-VolumesActionsTest-233834405 None] Copy volume to image completed successfully. Apr 10 13:23:33 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:INSERT=2,cinder:SELECT=10,cinder:UPDATE=4 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:23:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:33 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc83c7b-c902-4d65-82e0-728c416e8a53]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:33 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 Apr 10 13:23:33 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:33 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451" returned: 0 in 0.470s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:33 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[03736d23-b331-48a8-917b-e831bf5c26b0]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:33 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 Apr 10 13:23:33 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:34 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451" returned: 0 in 0.480s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:34 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img Apr 10 13:23:34 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:36 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img" returned: 0 in 1.937s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:36 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4717b88-d842-4535-b558-b5e61298ad29]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:36 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 Apr 10 13:23:36 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:36 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451" returned: 0 in 0.590s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:36 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:23:36 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Converted 1024.00 MB image at 528.32 MB/s Apr 10 13:23:36 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] b9e7534a-204d-41d2-ad6d-4fa702b92b9d was raw, converting to qcow2 {{(pid=82554) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 10 13:23:36 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae9ad28-1adc-4afb-aa6b-0e32b0da3ea3]: (4, 'raw') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:37 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img Apr 10 13:23:37 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:37 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img" returned: 0 in 0.441s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:37 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img Apr 10 13:23:37 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:37 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img" returned: 1 in 0.471s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img' failed. Not Retrying. {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 13:23:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img /opt/stack/data/cinder/conversion/vol_upload_44ag68mr {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:37 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img /opt/stack/data/cinder/conversion/vol_upload_44ag68mr Apr 10 13:23:37 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:38 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img /opt/stack/data/cinder/conversion/vol_upload_44ag68mr" returned: 0 in 0.417s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:38 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Image conversion details: src /opt/stack/data/cinder/conversion/a59a13e1-fc96-4c20-a169-9624f61c6451.temp_image.b9e7534a-204d-41d2-ad6d-4fa702b92b9dw37td92z.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_44ag68mr {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:23:38 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 10 13:23:38 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[85085738-3f15-4798-bd97-955ce82bb68a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_44ag68mr {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:38 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_44ag68mr Apr 10 13:23:38 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:38 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_44ag68mr" returned: 0 in 0.455s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.082s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Uploaded volume to glance image-id: b9e7534a-204d-41d2-ad6d-4fa702b92b9d. {{(pid=82554) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 13:23:39 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7e0f856e-5bb5-4167-93a3-15560cdd4fda tempest-VolumesActionsTest-233834405 None] Copy volume to image completed successfully. Apr 10 13:23:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Acquiring lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:23:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:23:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Acquiring lock "cinder-quobyte-a59a13e1-fc96-4c20-a169-9624f61c6451" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:23:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Lock "cinder-quobyte-a59a13e1-fc96-4c20-a169-9624f61c6451" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:23:40 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1d4a52-dadc-4c27-98b8-31188446632b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:40 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 Apr 10 13:23:40 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:40 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451" returned: 0 in 0.468s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:40 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451 Apr 10 13:23:40 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:40 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a59a13e1-fc96-4c20-a169-9624f61c6451" returned: 0 in 0.413s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Lock "cinder-quobyte-a59a13e1-fc96-4c20-a169-9624f61c6451" released by "delete_volume" :: held 0.915s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:23:40 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Created reservations ['0a91b290-e115-4e5f-b1cc-b35fcca5111d', '5ef691f2-83d8-4a0e-a12e-07e675dbb87b', 'e5f3ca43-522e-49a8-9ebf-ab7c14efd72f', '96b7ca13-92d9-43ef-ad09-587a73fe0a51'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:23:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:23:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:23:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:41 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:23:41 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:41 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.447s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:41 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:23:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Deleted volume successfully. Apr 10 13:23:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9cf91aa1-0682-44fb-b081-095130d99ec2 tempest-VolumesActionsTest-233834405 None] Lock "cinder-a59a13e1-fc96-4c20-a169-9624f61c6451-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Flow 'volume_create_manager' (9105cfd6-abf7-4b42-a90e-c220e2cca5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78550af8-fc0e-4b8f-8fd7-f364c4a0c1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78550af8-fc0e-4b8f-8fd7-f364c4a0c1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-109045879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a86192-f40a-4f6c-a3bb-9af2e6d79260,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9276f11cc3ad4eba84df754d3d8179ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:23:45Z,use_quota=True,user_id='db595911971b45b99d86a22e75ef0c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb2bd99-cc54-4f14-b652-6395b2265eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb2bd99-cc54-4f14-b652-6395b2265eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894dc621-fc35-46ea-a679-c20e2346ff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (894dc621-fc35-46ea-a679-c20e2346ff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a86192-f40a-4f6c-a3bb-9af2e6d79260', 'volume_name': 'volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe8885d-80ed-45b5-aeab-23c1590def9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe8885d-80ed-45b5-aeab-23c1590def9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e281b3-a18b-4aa0-86cc-6c2b5d72d9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:44 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Volume e1a86192-f40a-4f6c-a3bb-9af2e6d79260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260', 'volume_size': 1} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-109045879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a86192-f40a-4f6c-a3bb-9af2e6d79260,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9276f11cc3ad4eba84df754d3d8179ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:23:45Z,use_quota=True,user_id='db595911971b45b99d86a22e75ef0c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Creating volume e1a86192-f40a-4f6c-a3bb-9af2e6d79260 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:23:44 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:23:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:44 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260 1073741824 Apr 10 13:23:44 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:45 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260 1073741824" returned: 0 in 0.481s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:45 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260 Apr 10 13:23:45 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:45 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260" returned: 0 in 0.427s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:45 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:23:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e281b3-a18b-4aa0-86cc-6c2b5d72d9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8b8ce3-784b-489b-a35e-9423596cb8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:45 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Volume volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260 (e1a86192-f40a-4f6c-a3bb-9af2e6d79260): created successfully Apr 10 13:23:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8b8ce3-784b-489b-a35e-9423596cb8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Flow 'volume_create_manager' (9105cfd6-abf7-4b42-a90e-c220e2cca5f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:23:45 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b15e76aa-8b11-4f0c-a802-d6f49775a557 tempest-VolumesListTestJSON-824225596 None] Created volume successfully. Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Flow 'volume_create_manager' (a5ba4d0e-e573-4f16-a3d9-6d356a36b0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016dcf44-72a0-4b6c-af30-0b7cc3b288be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016dcf44-72a0-4b6c-af30-0b7cc3b288be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1740260121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c50105-d4d2-48dd-8f17-e1fcbab011a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9276f11cc3ad4eba84df754d3d8179ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:23:47Z,use_quota=True,user_id='db595911971b45b99d86a22e75ef0c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241c1df6-65fe-48ec-a8d6-e19f80f2355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241c1df6-65fe-48ec-a8d6-e19f80f2355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ebfa98-2d91-4148-80df-0310fc484584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ebfa98-2d91-4148-80df-0310fc484584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c50105-d4d2-48dd-8f17-e1fcbab011a6', 'volume_name': 'volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc14ce7-475b-4764-b698-0faf7df6f58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc14ce7-475b-4764-b698-0faf7df6f58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1701b8-3e10-4eb6-abd3-520f7ce3a818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:47 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Volume b1c50105-d4d2-48dd-8f17-e1fcbab011a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6', 'volume_size': 1} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1740260121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c50105-d4d2-48dd-8f17-e1fcbab011a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9276f11cc3ad4eba84df754d3d8179ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:23:47Z,use_quota=True,user_id='db595911971b45b99d86a22e75ef0c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Creating volume b1c50105-d4d2-48dd-8f17-e1fcbab011a6 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:23:47 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:47 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6 1073741824 Apr 10 13:23:47 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:47 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6 1073741824" returned: 0 in 0.483s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:47 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6 Apr 10 13:23:47 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:48 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6" returned: 0 in 0.419s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:23:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1701b8-3e10-4eb6-abd3-520f7ce3a818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471f4d7c-9994-4505-8b63-088bc1ed7316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:48 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Volume volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6 (b1c50105-d4d2-48dd-8f17-e1fcbab011a6): created successfully Apr 10 13:23:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471f4d7c-9994-4505-8b63-088bc1ed7316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Flow 'volume_create_manager' (a5ba4d0e-e573-4f16-a3d9-6d356a36b0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:23:48 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-951b2074-5a63-4b81-9868-1db0d63d76e3 tempest-VolumesListTestJSON-824225596 None] Created volume successfully. Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Flow 'volume_create_manager' (cf20a73a-fe84-400e-9bf9-7de6c0e7e140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db10d00c-972c-4d34-9c33-d98ec248f921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db10d00c-972c-4d34-9c33-d98ec248f921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-58622346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5dd16f-a157-4610-a580-97ca9158c1b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9276f11cc3ad4eba84df754d3d8179ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:23:49Z,use_quota=True,user_id='db595911971b45b99d86a22e75ef0c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237ad266-92c2-4e4a-8616-30ced001b84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237ad266-92c2-4e4a-8616-30ced001b84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e180f1-c3bc-4568-b290-caf2d632dc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e180f1-c3bc-4568-b290-caf2d632dc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb5dd16f-a157-4610-a580-97ca9158c1b4', 'volume_name': 'volume-cb5dd16f-a157-4610-a580-97ca9158c1b4', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515f36ee-265d-4f95-9ff0-d756a0011509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515f36ee-265d-4f95-9ff0-d756a0011509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453ff070-cad8-4054-b6c0-7149ad74786d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:49 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Volume cb5dd16f-a157-4610-a580-97ca9158c1b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb5dd16f-a157-4610-a580-97ca9158c1b4', 'volume_size': 1} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-58622346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5dd16f-a157-4610-a580-97ca9158c1b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9276f11cc3ad4eba84df754d3d8179ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:23:49Z,use_quota=True,user_id='db595911971b45b99d86a22e75ef0c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Creating volume cb5dd16f-a157-4610-a580-97ca9158c1b4 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:23:49 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:49 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4 1073741824 Apr 10 13:23:49 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:49 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4 1073741824" returned: 0 in 0.499s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:49 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4 Apr 10 13:23:49 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:50 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4" returned: 0 in 0.414s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:23:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453ff070-cad8-4054-b6c0-7149ad74786d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5dd16f-a157-4610-a580-97ca9158c1b4', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b545b992-b47b-4bf4-b696-0ff281adcb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:23:50 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Volume volume-cb5dd16f-a157-4610-a580-97ca9158c1b4 (cb5dd16f-a157-4610-a580-97ca9158c1b4): created successfully Apr 10 13:23:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b545b992-b47b-4bf4-b696-0ff281adcb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:23:50 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Flow 'volume_create_manager' (cf20a73a-fe84-400e-9bf9-7de6c0e7e140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:23:50 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-411b511b-d287-48ab-aab5-f4344d0ae2f1 tempest-VolumesListTestJSON-824225596 None] Created volume successfully. Apr 10 13:23:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Acquiring lock "cinder-cb5dd16f-a157-4610-a580-97ca9158c1b4-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:23:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Lock "cinder-cb5dd16f-a157-4610-a580-97ca9158c1b4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:23:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Acquiring lock "cinder-quobyte-cb5dd16f-a157-4610-a580-97ca9158c1b4" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:23:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Lock "cinder-quobyte-cb5dd16f-a157-4610-a580-97ca9158c1b4" acquired by "delete_volume" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:23:53 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d4071e-990e-473d-a33f-d275a90740d5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:53 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4 Apr 10 13:23:53 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:54 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4" returned: 0 in 0.476s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:54 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4 Apr 10 13:23:54 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:54 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-cb5dd16f-a157-4610-a580-97ca9158c1b4" returned: 0 in 0.420s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Lock "cinder-quobyte-cb5dd16f-a157-4610-a580-97ca9158c1b4" released by "delete_volume" :: held 0.924s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Created reservations ['523afe69-70e2-4d1d-ae85-67f83a207bdd', 'c93fe89a-2038-4f38-b9f5-806c55c814c1', '99a84b3f-2ead-4501-8c79-52c422000a2f', 'ddb557d6-895a-4b9b-a7a6-688ff191bdbf'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:54 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:23:54 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "cinder-b1c50105-d4d2-48dd-8f17-e1fcbab011a6-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Lock "cinder-b1c50105-d4d2-48dd-8f17-e1fcbab011a6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "cinder-quobyte-b1c50105-d4d2-48dd-8f17-e1fcbab011a6" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Lock "cinder-quobyte-b1c50105-d4d2-48dd-8f17-e1fcbab011a6" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[1698ed32-104c-4abe-8d20-91a23db45e6a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:54 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6 Apr 10 13:23:54 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:54 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.435s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:54 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:23:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Deleted volume successfully. Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7be420ce-ecab-416b-ac79-53e2a9bb172b tempest-VolumesListTestJSON-824225596 None] Lock "cinder-cb5dd16f-a157-4610-a580-97ca9158c1b4-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:23:55 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6" returned: 0 in 0.485s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:55 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6 Apr 10 13:23:55 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:55 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b1c50105-d4d2-48dd-8f17-e1fcbab011a6" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Lock "cinder-quobyte-b1c50105-d4d2-48dd-8f17-e1fcbab011a6" released by "delete_volume" :: held 0.921s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Created reservations ['ee3a094e-02b2-4f0f-805a-83ee61e801f1', '989d0c54-8ef8-4515-b15f-f11e9203c7fc', '251b6f7f-9174-4759-b1d1-d93db82803c5', 'c3a35417-f4fd-4f8b-aa7f-8a6cff3ff66e'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:55 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:23:55 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "cinder-e1a86192-f40a-4f6c-a3bb-9af2e6d79260-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Lock "cinder-e1a86192-f40a-4f6c-a3bb-9af2e6d79260-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "cinder-quobyte-e1a86192-f40a-4f6c-a3bb-9af2e6d79260" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Lock "cinder-quobyte-e1a86192-f40a-4f6c-a3bb-9af2e6d79260" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8310463f-8687-4b00-9a4d-c89c1453d85e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:23:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:55 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260 Apr 10 13:23:55 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:56 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.420s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:23:56 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Deleted volume successfully. Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3dec24ff-b6b0-48e5-927c-39014cc70960 tempest-VolumesListTestJSON-824225596 None] Lock "cinder-b1c50105-d4d2-48dd-8f17-e1fcbab011a6-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:23:56 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260" returned: 0 in 0.482s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:56 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260 Apr 10 13:23:56 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:56 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e1a86192-f40a-4f6c-a3bb-9af2e6d79260" returned: 0 in 0.413s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Lock "cinder-quobyte-e1a86192-f40a-4f6c-a3bb-9af2e6d79260" released by "delete_volume" :: held 0.916s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Created reservations ['33a440a1-7d28-4765-a06d-5551d6a87c86', '5a42e7eb-526c-49d3-8a9c-3ea1c4939362', '45b28a87-084c-4d33-ad4e-a67b168b0863', '2825fe83-f686-46f5-9597-a5dd12c22f9c'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:23:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:23:56 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:23:56 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:23:57 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 10 13:23:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.454s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:23:57 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:23:57 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Deleted volume successfully. Apr 10 13:23:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8960aa5b-d06a-4c34-b8fd-96e761834cf1 tempest-VolumesListTestJSON-824225596 None] Lock "cinder-e1a86192-f40a-4f6c-a3bb-9af2e6d79260-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Flow 'volume_create_manager' (57878274-019a-4898-847a-aef08f5823af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4034455-6747-4931-af5f-19385e06cf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4034455-6747-4931-af5f-19385e06cf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-427394496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70288600-8497-4ecc-9806-93042eb62171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959add2d7d124001ae24d11506eb29a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:24:06Z,use_quota=True,user_id='2878217098974124ad867e9079aeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d646cea-c132-4609-b283-bd552bffd552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d646cea-c132-4609-b283-bd552bffd552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aeb2ed4-0e7e-48ba-bd65-b5c4368933f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aeb2ed4-0e7e-48ba-bd65-b5c4368933f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70288600-8497-4ecc-9806-93042eb62171', 'volume_name': 'volume-70288600-8497-4ecc-9806-93042eb62171', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab2e59e-521e-4489-8acc-429ce2634bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab2e59e-521e-4489-8acc-429ce2634bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2db4931-6082-41cb-a8bd-db78a4bb5d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:05 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume 70288600-8497-4ecc-9806-93042eb62171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70288600-8497-4ecc-9806-93042eb62171', 'volume_size': 1} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-427394496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70288600-8497-4ecc-9806-93042eb62171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959add2d7d124001ae24d11506eb29a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:24:06Z,use_quota=True,user_id='2878217098974124ad867e9079aeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Creating volume 70288600-8497-4ecc-9806-93042eb62171 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:24:05 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:24:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:05 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 1073741824 Apr 10 13:24:05 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:06 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 1073741824" returned: 0 in 0.481s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:06 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 Apr 10 13:24:06 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:06 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171" returned: 0 in 0.411s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:24:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2db4931-6082-41cb-a8bd-db78a4bb5d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70288600-8497-4ecc-9806-93042eb62171', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb68ce0-4c17-4d1b-99eb-59dbc854e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:06 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume volume-70288600-8497-4ecc-9806-93042eb62171 (70288600-8497-4ecc-9806-93042eb62171): created successfully Apr 10 13:24:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb68ce0-4c17-4d1b-99eb-59dbc854e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Flow 'volume_create_manager' (57878274-019a-4898-847a-aef08f5823af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:24:06 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8cab0584-a188-4ad5-acef-955dd4f65ca8 tempest-VolumesSnapshotTestJSON-1954418176 None] Created volume successfully. Apr 10 13:24:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Creating offline snapshot 343c662f-f706-4496-9ee3-6b6231e274c9 of volume 70288600-8497-4ecc-9806-93042eb62171 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:24:08 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b406d4dc-011f-467b-aa92-ac7d0cee48ca]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:08 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 Apr 10 13:24:08 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:08 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171" returned: 0 in 0.462s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:08 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 1G Apr 10 13:24:08 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:09 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 1G" returned: 0 in 0.467s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70288600-8497-4ecc-9806-93042eb62171 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:09 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70288600-8497-4ecc-9806-93042eb62171 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 Apr 10 13:24:09 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:09 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70288600-8497-4ecc-9806-93042eb62171 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:09 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 is being set with open permissions: ugo+rw Apr 10 13:24:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:09 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 Apr 10 13:24:09 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:09 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9" returned: 0 in 0.407s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:09 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.info Apr 10 13:24:09 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:10 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.info" returned: 0 in 0.449s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:10 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.info is being set with open permissions: ugo+rw Apr 10 13:24:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:10 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.info Apr 10 13:24:10 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:10 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.info" returned: 0 in 0.406s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:10 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1543310c-d07e-472d-80f3-c75aa060236b tempest-VolumesSnapshotTestJSON-1954418176 None] Create snapshot completed successfully Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-343c662f-f706-4496-9ee3-6b6231e274c9-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-343c662f-f706-4496-9ee3-6b6231e274c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-70288600-8497-4ecc-9806-93042eb62171" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-70288600-8497-4ecc-9806-93042eb62171" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-343c662f-f706-4496-9ee3-6b6231e274c9" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-343c662f-f706-4496-9ee3-6b6231e274c9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Deleting offline snapshot 343c662f-f706-4496-9ee3-6b6231e274c9 of volume 70288600-8497-4ecc-9806-93042eb62171 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] snapshot_file for this snap is: volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94ef7d6-83cf-4cd6-9ae7-7205de43085c]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:11 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 Apr 10 13:24:11 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:11 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9" returned: 0 in 0.479s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70288600-8497-4ecc-9806-93042eb62171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[391c04b4-4c57-4e96-9eb4-9993c747bf5e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:11 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 Apr 10 13:24:11 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:12 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171" returned: 0 in 0.469s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:12 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 Apr 10 13:24:12 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:12 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9" returned: 0 in 0.454s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:12 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9 Apr 10 13:24:12 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:13 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171.343c662f-f706-4496-9ee3-6b6231e274c9" returned: 0 in 0.404s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-343c662f-f706-4496-9ee3-6b6231e274c9" released by "_delete_snapshot" :: held 1.858s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-70288600-8497-4ecc-9806-93042eb62171" released by "delete_snapshot" :: held 1.870s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Created reservations ['521f6fba-70ab-4d4b-9aaf-00af971ec829', 'dcfcfc62-c737-461b-a37a-2ac148a06b32', '82c54b15-a200-4468-8658-1089a79c6198', '4f776c71-36f5-42b9-b5e8-f54cc1be6d2b'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:24:13 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Delete snapshot completed successfully. Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-284c1475-976b-4d01-8be1-515254ef8f32 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-343c662f-f706-4496-9ee3-6b6231e274c9-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Flow 'volume_create_manager' (752e3c1d-029e-4ad3-a348-c374156bf161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82a08ea-72b0-4675-ae08-20d456ec36d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82a08ea-72b0-4675-ae08-20d456ec36d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1042197319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c210a4-ab5e-4621-9ff7-934e66e692e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959add2d7d124001ae24d11506eb29a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:24:14Z,use_quota=True,user_id='2878217098974124ad867e9079aeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360ed9c4-267c-411f-979b-a67f6c7cb3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360ed9c4-267c-411f-979b-a67f6c7cb3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcc7e26-8f90-48a5-ad2d-0507a5351c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcc7e26-8f90-48a5-ad2d-0507a5351c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c210a4-ab5e-4621-9ff7-934e66e692e4', 'volume_name': 'volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f421e5-76bb-4aef-aca6-f78b5dfa1f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f421e5-76bb-4aef-aca6-f78b5dfa1f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf872c3-fff6-496f-8bd1-df3e32542338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:13 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume b7c210a4-ab5e-4621-9ff7-934e66e692e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4', 'volume_size': 1} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1042197319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c210a4-ab5e-4621-9ff7-934e66e692e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959add2d7d124001ae24d11506eb29a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:24:14Z,use_quota=True,user_id='2878217098974124ad867e9079aeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Creating volume b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:24:13 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:24:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:13 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 1073741824 Apr 10 13:24:13 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:14 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 1073741824" returned: 0 in 0.481s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:14 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 Apr 10 13:24:14 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:14 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4" returned: 0 in 0.412s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:24:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf872c3-fff6-496f-8bd1-df3e32542338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b04211-58c8-48de-b67a-2efa0b30d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:14 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 (b7c210a4-ab5e-4621-9ff7-934e66e692e4): created successfully Apr 10 13:24:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b04211-58c8-48de-b67a-2efa0b30d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Flow 'volume_create_manager' (752e3c1d-029e-4ad3-a348-c374156bf161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:24:14 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-69b68243-76e3-42dc-a144-534b9685eed8 tempest-VolumesSnapshotTestJSON-1954418176 None] Created volume successfully. Apr 10 13:24:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Creating offline snapshot a55b1683-9506-43c5-a7ba-7bc05a9d181e of volume b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:24:15 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf37ca8-acbe-4881-87f8-19624c34b910]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:16 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 Apr 10 13:24:16 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:16 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4" returned: 0 in 0.464s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:16 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e 1G Apr 10 13:24:16 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:16 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e 1G" returned: 0 in 0.469s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:16 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e Apr 10 13:24:16 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:17 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e" returned: 0 in 0.424s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:17 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e is being set with open permissions: ugo+rw Apr 10 13:24:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:17 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e Apr 10 13:24:17 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:17 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:17 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.info Apr 10 13:24:17 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:18 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.info" returned: 0 in 0.423s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:18 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.info is being set with open permissions: ugo+rw Apr 10 13:24:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:18 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.info Apr 10 13:24:18 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:18 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.info" returned: 0 in 0.408s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:18 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-932d874a-27aa-4321-9df0-fea6cdd69c94 tempest-VolumesSnapshotTestJSON-1954418176 None] Create snapshot completed successfully Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Flow 'volume_create_manager' (a7084536-b3f5-40f7-9db4-773942cc72b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031a9bb4-8e7d-4243-9434-e12b6fb34d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031a9bb4-8e7d-4243-9434-e12b6fb34d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1935456404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f6afa2-1ffe-43ee-aef4-e177d24edfeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959add2d7d124001ae24d11506eb29a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:24:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a55b1683-9506-43c5-a7ba-7bc05a9d181e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:24:19Z,use_quota=True,user_id='2878217098974124ad867e9079aeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4da82a1-32ed-42d8-b40a-0a8da975a1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4da82a1-32ed-42d8-b40a-0a8da975a1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2248c26-0296-475c-bb44-944eb88f9585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2248c26-0296-475c-bb44-944eb88f9585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '11f6afa2-1ffe-43ee-aef4-e177d24edfeb', 'volume_name': 'volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb', 'volume_size': 2, 'snapshot_id': 'a55b1683-9506-43c5-a7ba-7bc05a9d181e'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469538d9-e5a4-4e9c-b15f-953385ffc347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469538d9-e5a4-4e9c-b15f-953385ffc347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e633ee8-c0d6-4038-b177-693a0d83c998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:19 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Volume 11f6afa2-1ffe-43ee-aef4-e177d24edfeb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb', 'volume_size': 2, 'snapshot_id': 'a55b1683-9506-43c5-a7ba-7bc05a9d181e'} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-a55b1683-9506-43c5-a7ba-7bc05a9d181e-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" by "_create_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-a55b1683-9506-43c5-a7ba-7bc05a9d181e-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Creating volume 11f6afa2-1ffe-43ee-aef4-e177d24edfeb from snapshot a55b1683-9506-43c5-a7ba-7bc05a9d181e {{(pid=82554) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] snapshot: a55b1683-9506-43c5-a7ba-7bc05a9d181e, volume: 11f6afa2-1ffe-43ee-aef4-e177d24edfeb, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[20417550-074f-4e49-b7a8-8cbc82fe3ff3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:19 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e Apr 10 13:24:19 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:19 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e" returned: 0 in 0.483s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c57a47-7002-4200-a436-580fb49fdcf9]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:19 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 Apr 10 13:24:19 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:20 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4" returned: 0 in 0.473s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:20 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:24:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:20 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb Apr 10 13:24:20 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:22 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" returned: 0 in 1.935s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:22 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2975e3c0-54bd-44db-bbcc-b92b53b976de]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:22 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 Apr 10 13:24:22 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:22 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4" returned: 0 in 0.597s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:22 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:24:22 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Converted 1024.00 MB image at 528.92 MB/s Apr 10 13:24:22 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb is being set with open permissions: ugo+rw Apr 10 13:24:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:22 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb Apr 10 13:24:22 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:23 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" returned: 0 in 0.414s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" released by "_copy_volume_from_snapshot" :: held 3.951s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-a55b1683-9506-43c5-a7ba-7bc05a9d181e-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" released by "_create_volume_from_snapshot" :: held 3.965s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.973s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e633ee8-c0d6-4038-b177-693a0d83c998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb', 'volume_size': 2, 'snapshot_id': 'a55b1683-9506-43c5-a7ba-7bc05a9d181e'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8a0ed3-6e98-4690-8bae-2ef39ba6d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:23 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Volume volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb (11f6afa2-1ffe-43ee-aef4-e177d24edfeb): created successfully Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8a0ed3-6e98-4690-8bae-2ef39ba6d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Flow 'volume_create_manager' (a7084536-b3f5-40f7-9db4-773942cc72b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:24:23 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-542706a8-7914-4de8-b8e1-dcbc2036920c tempest-VolumesSnapshotTestJSON-1954418176 None] Created volume successfully. Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-11f6afa2-1ffe-43ee-aef4-e177d24edfeb-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-11f6afa2-1ffe-43ee-aef4-e177d24edfeb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[27607fff-f2c9-48d2-ac62-632f0f38e058]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:23 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb Apr 10 13:24:23 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:24 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" returned: 0 in 0.486s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:24 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb Apr 10 13:24:24 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:24 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" returned: 0 in 0.411s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-11f6afa2-1ffe-43ee-aef4-e177d24edfeb" released by "delete_volume" :: held 0.925s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=48,cinder:UPDATE=70,cinder:INSERT=13,cinder:DELETE=5 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Created reservations ['607674cb-5223-4fa9-8c5a-694c580d8bef', 'ceb214c4-ef0e-43e5-8c08-603e79cc1e6b', '58522d8b-ea5d-4cac-8602-47fb371e1eff', '1ba6cb2e-f0df-42f1-92f7-977ed1870c82'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:24 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:24:24 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-a55b1683-9506-43c5-a7ba-7bc05a9d181e-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-a55b1683-9506-43c5-a7ba-7bc05a9d181e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-b7c210a4-ab5e-4621-9ff7-934e66e692e4" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-b7c210a4-ab5e-4621-9ff7-934e66e692e4" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-a55b1683-9506-43c5-a7ba-7bc05a9d181e" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-a55b1683-9506-43c5-a7ba-7bc05a9d181e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Deleting offline snapshot a55b1683-9506-43c5-a7ba-7bc05a9d181e of volume b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] snapshot_file for this snap is: volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd7684b-c7a8-4440-a653-98959e5bfbaf]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:24 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e Apr 10 13:24:24 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:25 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.409s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:25 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:24:25 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Deleted volume successfully. Apr 10 13:24:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3fed9bb9-5256-4012-a12a-fea9ebd3f1a2 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-11f6afa2-1ffe-43ee-aef4-e177d24edfeb-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:25 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e" returned: 0 in 0.465s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:24:25 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b4c9f6-2518-420d-9365-32e9c1a2e97b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:25 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 Apr 10 13:24:25 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:25 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4" returned: 0 in 0.457s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:25 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e Apr 10 13:24:25 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:26 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e" returned: 0 in 0.451s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:26 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e Apr 10 13:24:26 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:26 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4.a55b1683-9506-43c5-a7ba-7bc05a9d181e" returned: 0 in 0.399s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-a55b1683-9506-43c5-a7ba-7bc05a9d181e" released by "_delete_snapshot" :: held 1.832s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-b7c210a4-ab5e-4621-9ff7-934e66e692e4" released by "delete_snapshot" :: held 1.845s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Created reservations ['b5f8288d-b8d2-4bec-b0ce-07cbe27db048', '63822fcc-7f7e-4778-9631-dcc40c8b4c24', '5e4fe982-928d-4def-8aa5-0b411875fcd9', '811bb693-7807-4088-891c-b0c2893b9a2b'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:24:26 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Delete snapshot completed successfully. Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-76cf990f-a701-46c8-8fae-7c0ad615dfc1 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-a55b1683-9506-43c5-a7ba-7bc05a9d181e-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-b7c210a4-ab5e-4621-9ff7-934e66e692e4-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-b7c210a4-ab5e-4621-9ff7-934e66e692e4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-b7c210a4-ab5e-4621-9ff7-934e66e692e4" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:26 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-b7c210a4-ab5e-4621-9ff7-934e66e692e4" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ec2b78-c537-4647-ba0c-0614ae8d2c62]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:27 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 Apr 10 13:24:27 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:27 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4" returned: 0 in 0.465s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:27 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4 Apr 10 13:24:27 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:27 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b7c210a4-ab5e-4621-9ff7-934e66e692e4" returned: 0 in 0.411s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-b7c210a4-ab5e-4621-9ff7-934e66e692e4" released by "delete_volume" :: held 0.913s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Created reservations ['7617edb0-e401-4eb9-b5a8-c3853e1d512b', '83615977-a2fd-4942-9680-0f8fc6d66dd4', 'bfc178d6-2fa4-47e9-9282-0ca5b74aed93', 'c14fe5a9-a5e8-49a9-97b2-f439a763a6b8'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:27 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:24:27 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Flow 'volume_create_manager' (8203dfc6-67a5-41c3-b15e-5299b42d7649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576e2bc0-f94a-43f1-9574-2a4e34b2b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576e2bc0-f94a-43f1-9574-2a4e34b2b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1076724744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c24edb-31f7-4f30-a843-ea1058beebcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959add2d7d124001ae24d11506eb29a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:24:28Z,use_quota=True,user_id='2878217098974124ad867e9079aeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134b2e9d-3803-44d4-82a4-1fc28efa078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134b2e9d-3803-44d4-82a4-1fc28efa078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53176a3-c30b-45a6-836b-b10d044892a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53176a3-c30b-45a6-836b-b10d044892a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c24edb-31f7-4f30-a843-ea1058beebcf', 'volume_name': 'volume-14c24edb-31f7-4f30-a843-ea1058beebcf', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732e15e0-56b5-4e75-85ff-bfc849a6086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732e15e0-56b5-4e75-85ff-bfc849a6086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291174a2-1df5-4848-8141-ff6b6b2af9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:28 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume 14c24edb-31f7-4f30-a843-ea1058beebcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c24edb-31f7-4f30-a843-ea1058beebcf', 'volume_size': 1} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1076724744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c24edb-31f7-4f30-a843-ea1058beebcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959add2d7d124001ae24d11506eb29a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:24:28Z,use_quota=True,user_id='2878217098974124ad867e9079aeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Creating volume 14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:24:28 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:28 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf 1073741824 Apr 10 13:24:28 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:28 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.465s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:24:28 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Deleted volume successfully. Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-179f48b4-5050-460d-b6bd-5ca68c5af7f5 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-b7c210a4-ab5e-4621-9ff7-934e66e692e4-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:28 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf 1073741824" returned: 0 in 0.501s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:28 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf Apr 10 13:24:28 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:29 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:24:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291174a2-1df5-4848-8141-ff6b6b2af9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c24edb-31f7-4f30-a843-ea1058beebcf', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9217854-91f9-4a11-b0d2-49e1d9074380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:29 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume volume-14c24edb-31f7-4f30-a843-ea1058beebcf (14c24edb-31f7-4f30-a843-ea1058beebcf): created successfully Apr 10 13:24:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9217854-91f9-4a11-b0d2-49e1d9074380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Flow 'volume_create_manager' (8203dfc6-67a5-41c3-b15e-5299b42d7649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:24:29 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7157b2f4-d034-4751-9ed4-d03da4ee98c3 tempest-VolumesSnapshotTestJSON-1954418176 None] Created volume successfully. Apr 10 13:24:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Creating offline snapshot 03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 of volume 14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:24:30 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4343166c-fd16-40bb-be00-30fbd0513178]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:30 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf Apr 10 13:24:30 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:31 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf" returned: 0 in 0.469s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:31 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 1G Apr 10 13:24:31 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:31 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 1G" returned: 0 in 0.462s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c24edb-31f7-4f30-a843-ea1058beebcf -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:31 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c24edb-31f7-4f30-a843-ea1058beebcf -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 Apr 10 13:24:31 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:31 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14c24edb-31f7-4f30-a843-ea1058beebcf -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7" returned: 0 in 0.431s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:31 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 is being set with open permissions: ugo+rw Apr 10 13:24:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:31 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 Apr 10 13:24:31 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:32 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7" returned: 0 in 0.404s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:32 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.info Apr 10 13:24:32 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:32 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.info" returned: 0 in 0.412s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:32 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.info is being set with open permissions: ugo+rw Apr 10 13:24:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:32 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.info Apr 10 13:24:32 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:33 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.info" returned: 0 in 0.401s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=85,cinder:INSERT=21,cinder:UPDATE=86,cinder:DELETE=8 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:24:33 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-80901939-78ba-4f09-ad1e-27f6993c33c9 tempest-VolumesSnapshotTestJSON-1954418176 None] Create snapshot completed successfully Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Flow 'volume_create_manager' (40f08ea1-e612-4bf0-ac2e-35556c6c04dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c26ae78-19e9-4848-a11a-5dd4081ae393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c26ae78-19e9-4848-a11a-5dd4081ae393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-607762466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb587d0b-32c2-4046-82e5-859caeb8019b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959add2d7d124001ae24d11506eb29a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03d78d4d-a03e-40e2-acbe-46d3aeef9ff7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:24:34Z,use_quota=True,user_id='2878217098974124ad867e9079aeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e05106-6ee6-42bc-a31b-92e1ef1f8a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e05106-6ee6-42bc-a31b-92e1ef1f8a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd34168-8c37-4e87-84cc-4a12ba939949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd34168-8c37-4e87-84cc-4a12ba939949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb587d0b-32c2-4046-82e5-859caeb8019b', 'volume_name': 'volume-fb587d0b-32c2-4046-82e5-859caeb8019b', 'volume_size': 1, 'snapshot_id': '03d78d4d-a03e-40e2-acbe-46d3aeef9ff7'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96263507-9bac-4721-82d2-567846d918b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96263507-9bac-4721-82d2-567846d918b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7558ad-ff54-4e67-8eda-b7ce82cab608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:33 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume fb587d0b-32c2-4046-82e5-859caeb8019b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb587d0b-32c2-4046-82e5-859caeb8019b', 'volume_size': 1, 'snapshot_id': '03d78d4d-a03e-40e2-acbe-46d3aeef9ff7'} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-03d78d4d-a03e-40e2-acbe-46d3aeef9ff7-fb587d0b-32c2-4046-82e5-859caeb8019b" by "_create_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-03d78d4d-a03e-40e2-acbe-46d3aeef9ff7-fb587d0b-32c2-4046-82e5-859caeb8019b" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Creating volume fb587d0b-32c2-4046-82e5-859caeb8019b from snapshot 03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 {{(pid=82554) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-fb587d0b-32c2-4046-82e5-859caeb8019b" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-fb587d0b-32c2-4046-82e5-859caeb8019b" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] snapshot: 03d78d4d-a03e-40e2-acbe-46d3aeef9ff7, volume: fb587d0b-32c2-4046-82e5-859caeb8019b, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf31fa5d-076b-4363-8755-d26766eeeedd]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:34 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 Apr 10 13:24:34 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:34 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7" returned: 0 in 0.459s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14c24edb-31f7-4f30-a843-ea1058beebcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dadeec-a83a-4b03-b0b6-5af902a94053]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:34 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf Apr 10 13:24:34 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:34 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf" returned: 0 in 0.491s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:24:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:34 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b Apr 10 13:24:34 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:36 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b" returned: 0 in 1.941s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:36 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[283f5326-5675-4214-9252-64f69f3e39ee]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:36 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf Apr 10 13:24:36 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:37 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf" returned: 0 in 0.589s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:24:37 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Converted 1024.00 MB image at 527.24 MB/s Apr 10 13:24:37 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b is being set with open permissions: ugo+rw Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:37 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b Apr 10 13:24:37 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:37 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b" returned: 0 in 0.409s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-fb587d0b-32c2-4046-82e5-859caeb8019b" released by "_copy_volume_from_snapshot" :: held 3.940s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-03d78d4d-a03e-40e2-acbe-46d3aeef9ff7-fb587d0b-32c2-4046-82e5-859caeb8019b" released by "_create_volume_from_snapshot" :: held 3.957s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.964s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7558ad-ff54-4e67-8eda-b7ce82cab608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb587d0b-32c2-4046-82e5-859caeb8019b', 'volume_size': 1, 'snapshot_id': '03d78d4d-a03e-40e2-acbe-46d3aeef9ff7'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5301cd20-a4f7-45e6-a3ca-a8351e90b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:24:37 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Volume volume-fb587d0b-32c2-4046-82e5-859caeb8019b (fb587d0b-32c2-4046-82e5-859caeb8019b): created successfully Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5301cd20-a4f7-45e6-a3ca-a8351e90b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:24:37 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Flow 'volume_create_manager' (40f08ea1-e612-4bf0-ac2e-35556c6c04dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:24:37 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-b265bc6d-1926-42f9-ae97-6bdc299a2121 tempest-VolumesSnapshotTestJSON-1954418176 None] Created volume successfully. Apr 10 13:24:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-fb587d0b-32c2-4046-82e5-859caeb8019b-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-fb587d0b-32c2-4046-82e5-859caeb8019b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-fb587d0b-32c2-4046-82e5-859caeb8019b" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-fb587d0b-32c2-4046-82e5-859caeb8019b" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:38 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[42750e26-205a-41fe-8ddb-ce429d404e00]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:38 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b Apr 10 13:24:38 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:38 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b" returned: 0 in 0.485s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:38 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b Apr 10 13:24:38 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:39 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-fb587d0b-32c2-4046-82e5-859caeb8019b" returned: 0 in 0.404s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-fb587d0b-32c2-4046-82e5-859caeb8019b" released by "delete_volume" :: held 0.917s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Created reservations ['05468ac4-b124-4ad8-8d19-c3aceb21f838', 'ecd98962-e8a9-4cc1-ab19-c463a94fbd96', '424462e9-39d4-414e-91a0-1937e33b968a', 'de9ed01a-2037-416d-a2bb-090aae5104b8'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:39 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:24:39 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-03d78d4d-a03e-40e2-acbe-46d3aeef9ff7-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-03d78d4d-a03e-40e2-acbe-46d3aeef9ff7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-14c24edb-31f7-4f30-a843-ea1058beebcf" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-14c24edb-31f7-4f30-a843-ea1058beebcf" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-03d78d4d-a03e-40e2-acbe-46d3aeef9ff7" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-03d78d4d-a03e-40e2-acbe-46d3aeef9ff7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Deleting offline snapshot 03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 of volume 14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] snapshot_file for this snap is: volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[56087482-5089-4041-9373-53eb7a0dbb9b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:39 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 Apr 10 13:24:39 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:39 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.429s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:24:39 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Deleted volume successfully. Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-3e18741b-dd87-4a99-bbd8-d03defe1b62f tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-fb587d0b-32c2-4046-82e5-859caeb8019b-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:39 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7" returned: 0 in 0.471s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14c24edb-31f7-4f30-a843-ea1058beebcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a77c60f-eaf5-47cc-b0d4-5ff75a7cfbf0]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:40 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf Apr 10 13:24:40 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:40 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf" returned: 0 in 0.461s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:40 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 Apr 10 13:24:40 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:40 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7" returned: 0 in 0.447s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:40 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7 Apr 10 13:24:40 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:41 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf.03d78d4d-a03e-40e2-acbe-46d3aeef9ff7" returned: 0 in 0.408s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-03d78d4d-a03e-40e2-acbe-46d3aeef9ff7" released by "_delete_snapshot" :: held 1.850s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-14c24edb-31f7-4f30-a843-ea1058beebcf" released by "delete_snapshot" :: held 1.872s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Created reservations ['80f46384-4e1f-4f6f-8002-47dc5a58c20e', 'c3543f4e-018d-4c77-a42a-33815dec4ccd', '2d87e4cd-8d47-40f9-955b-974319596add', 'e6d2618f-52fa-4108-93cc-8aa4bd147950'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:24:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Delete snapshot completed successfully. Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-37d3ea4a-7dbb-4bb0-a0b4-483cd5ca4d4c tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-03d78d4d-a03e-40e2-acbe-46d3aeef9ff7-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-14c24edb-31f7-4f30-a843-ea1058beebcf-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-14c24edb-31f7-4f30-a843-ea1058beebcf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-14c24edb-31f7-4f30-a843-ea1058beebcf" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-14c24edb-31f7-4f30-a843-ea1058beebcf" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bda3bd-537c-4960-a4be-54cbfb47bec4]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:41 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf Apr 10 13:24:41 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:42 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf" returned: 0 in 0.461s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:42 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf Apr 10 13:24:42 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:42 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-14c24edb-31f7-4f30-a843-ea1058beebcf" returned: 0 in 0.399s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-14c24edb-31f7-4f30-a843-ea1058beebcf" released by "delete_volume" :: held 0.905s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Created reservations ['a5974e76-d305-4f82-9058-c8ff8e4a1995', '904be83a-e155-47ee-a7cc-04a1e58bae9e', '945bf719-ae3b-43f1-a20f-f759430e5b18', '60d35e3a-b2ad-4e8d-ad4a-cbb7e6d53f14'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:42 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:24:42 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-70288600-8497-4ecc-9806-93042eb62171-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-70288600-8497-4ecc-9806-93042eb62171-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "cinder-quobyte-70288600-8497-4ecc-9806-93042eb62171" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-70288600-8497-4ecc-9806-93042eb62171" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e9a55d-1f5d-4f1d-b040-ff71de9793bb]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:24:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:42 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 Apr 10 13:24:42 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:43 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.426s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:24:43 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Deleted volume successfully. Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8adb4535-fb68-4f45-9cab-0365eca5ee62 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-14c24edb-31f7-4f30-a843-ea1058beebcf-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:43 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171" returned: 0 in 0.471s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:43 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171 Apr 10 13:24:43 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:43 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-70288600-8497-4ecc-9806-93042eb62171" returned: 0 in 0.409s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-quobyte-70288600-8497-4ecc-9806-93042eb62171" released by "delete_volume" :: held 0.916s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Created reservations ['8ed96ab0-5b8c-4354-85fe-98715d03c32a', '94106bfb-4577-4068-a8d1-d3b966c45abd', 'a4e1a82a-9564-41fb-adc7-1e104ff63df3', '2faaac64-43ab-4386-bb0f-d2580895b50f'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:24:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:24:43 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:24:43 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:24:44 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 10 13:24:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.431s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:24:44 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:24:44 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Deleted volume successfully. Apr 10 13:24:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ef040b03-47c3-4e61-a669-fff957f0ec02 tempest-VolumesSnapshotTestJSON-1954418176 None] Lock "cinder-70288600-8497-4ecc-9806-93042eb62171-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:24:53 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=26,cinder:UPDATE=36,cinder:DELETE=2,cinder:INSERT=8 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:24:54 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:UPDATE=41,cinder:DELETE=5,cinder:SELECT=36,cinder:INSERT=15 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Flow 'volume_create_manager' (61af8665-83ac-4a3c-81c6-e9bcc1223911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527f50c2-78ca-4de9-9ac7-fabb48940dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527f50c2-78ca-4de9-9ac7-fabb48940dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-802866573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0352529a-af8b-4163-93de-ae60580c7427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0e3d7581244f6cb823965708924a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:00Z,use_quota=True,user_id='4f686f565d1941d3bba2ee79ee40ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa4e276-d797-4e2d-9d40-26058cda4517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa4e276-d797-4e2d-9d40-26058cda4517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0032d9c-d35f-4105-b919-db2e607d2a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0032d9c-d35f-4105-b919-db2e607d2a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0352529a-af8b-4163-93de-ae60580c7427', 'volume_name': 'volume-0352529a-af8b-4163-93de-ae60580c7427', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce031ee-a991-4cb5-806a-33086e4ccbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce031ee-a991-4cb5-806a-33086e4ccbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f50e99-f39f-40a9-9da0-e41ba91c5a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:00 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Volume 0352529a-af8b-4163-93de-ae60580c7427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0352529a-af8b-4163-93de-ae60580c7427', 'volume_size': 1} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-802866573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0352529a-af8b-4163-93de-ae60580c7427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0e3d7581244f6cb823965708924a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:00Z,use_quota=True,user_id='4f686f565d1941d3bba2ee79ee40ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Creating volume 0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:00 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:00 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 1073741824 Apr 10 13:25:00 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:01 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 1073741824" returned: 0 in 0.500s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:01 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 Apr 10 13:25:01 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:01 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427" returned: 0 in 0.417s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f50e99-f39f-40a9-9da0-e41ba91c5a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0352529a-af8b-4163-93de-ae60580c7427', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7aef01-602b-4221-bf2c-41a66fa15b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:01 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Volume volume-0352529a-af8b-4163-93de-ae60580c7427 (0352529a-af8b-4163-93de-ae60580c7427): created successfully Apr 10 13:25:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7aef01-602b-4221-bf2c-41a66fa15b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Flow 'volume_create_manager' (61af8665-83ac-4a3c-81c6-e9bcc1223911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-e10ebadd-dc1b-4b8c-bbc0-e2666b42f230 tempest-SnapshotDependencyTests-617390706 None] Created volume successfully. Apr 10 13:25:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Creating offline snapshot 9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e of volume 0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:25:02 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab55bc5-ce01-432a-9b65-bdfbb9899acb]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:02 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 Apr 10 13:25:02 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:03 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427" returned: 0 in 0.475s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:03 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e 1G Apr 10 13:25:03 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:03 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e 1G" returned: 0 in 0.453s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0352529a-af8b-4163-93de-ae60580c7427 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:03 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0352529a-af8b-4163-93de-ae60580c7427 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e Apr 10 13:25:03 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:04 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0352529a-af8b-4163-93de-ae60580c7427 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e" returned: 0 in 0.431s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:04 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e is being set with open permissions: ugo+rw Apr 10 13:25:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:04 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e Apr 10 13:25:04 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:04 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e" returned: 0 in 0.405s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:04 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.info Apr 10 13:25:04 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:04 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.info" returned: 0 in 0.416s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:04 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.info is being set with open permissions: ugo+rw Apr 10 13:25:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:04 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.info Apr 10 13:25:04 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:05 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.info" returned: 0 in 0.413s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:05 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3e3ecd1a-6404-430c-aca0-dfa406210d3c tempest-SnapshotDependencyTests-617390706 None] Create snapshot completed successfully Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Flow 'volume_create_manager' (a93a69ac-ddc9-4ca1-a4ab-9f23acb441bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2aaace-d530-4275-85e1-56311565c2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e2aaace-d530-4275-85e1-56311565c2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded48931-3cb6-468a-9255-798c9fff1cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0e3d7581244f6cb823965708924a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:06Z,use_quota=True,user_id='4f686f565d1941d3bba2ee79ee40ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b84483-1b47-4a04-83a6-da1d1c874fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b84483-1b47-4a04-83a6-da1d1c874fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6d416b-02f6-475b-b314-383d81e08a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6d416b-02f6-475b-b314-383d81e08a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ded48931-3cb6-468a-9255-798c9fff1cfc', 'volume_name': 'volume-ded48931-3cb6-468a-9255-798c9fff1cfc', 'volume_size': 1, 'snapshot_id': '9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641a43e2-ead5-41f6-8487-a7f99f54db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641a43e2-ead5-41f6-8487-a7f99f54db83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1eaced-d920-4deb-b83e-1663d1457cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:06 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Volume ded48931-3cb6-468a-9255-798c9fff1cfc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ded48931-3cb6-468a-9255-798c9fff1cfc', 'volume_size': 1, 'snapshot_id': '9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e'} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "cinder-quobyte-9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e-ded48931-3cb6-468a-9255-798c9fff1cfc" by "_create_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e-ded48931-3cb6-468a-9255-798c9fff1cfc" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Creating volume ded48931-3cb6-468a-9255-798c9fff1cfc from snapshot 9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e {{(pid=82554) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "cinder-quobyte-ded48931-3cb6-468a-9255-798c9fff1cfc" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-ded48931-3cb6-468a-9255-798c9fff1cfc" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] snapshot: 9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e, volume: ded48931-3cb6-468a-9255-798c9fff1cfc, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3d1c07-cbaf-46f0-959e-298ce0a9a9f3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:06 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e Apr 10 13:25:06 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:06 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e" returned: 0 in 0.475s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0352529a-af8b-4163-93de-ae60580c7427(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cac0800-65de-4f87-95c7-a94c61bf7880]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:06 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 Apr 10 13:25:06 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:07 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427" returned: 0 in 0.469s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:07 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:25:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:07 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc Apr 10 13:25:07 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:09 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc" returned: 0 in 1.923s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:09 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abb67dd-ebc1-485f-83c5-624fbb37f427]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:09 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 Apr 10 13:25:09 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:09 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427" returned: 0 in 0.596s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:09 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:25:09 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Converted 1024.00 MB image at 532.22 MB/s Apr 10 13:25:09 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc is being set with open permissions: ugo+rw Apr 10 13:25:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:09 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc Apr 10 13:25:09 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:10 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc" returned: 0 in 0.397s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-ded48931-3cb6-468a-9255-798c9fff1cfc" released by "_copy_volume_from_snapshot" :: held 3.913s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e-ded48931-3cb6-468a-9255-798c9fff1cfc" released by "_create_volume_from_snapshot" :: held 3.928s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.937s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1eaced-d920-4deb-b83e-1663d1457cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded48931-3cb6-468a-9255-798c9fff1cfc', 'volume_size': 1, 'snapshot_id': '9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b83e449-7537-4895-86d4-a102baabf40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:10 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Volume volume-ded48931-3cb6-468a-9255-798c9fff1cfc (ded48931-3cb6-468a-9255-798c9fff1cfc): created successfully Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b83e449-7537-4895-86d4-a102baabf40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Flow 'volume_create_manager' (a93a69ac-ddc9-4ca1-a4ab-9f23acb441bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:10 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9ddb2dc6-1d1a-48db-b63a-ed17eb168fb6 tempest-SnapshotDependencyTests-617390706 None] Created volume successfully. Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "cinder-9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "cinder-quobyte-0352529a-af8b-4163-93de-ae60580c7427" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-0352529a-af8b-4163-93de-ae60580c7427" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "cinder-quobyte-9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Deleting offline snapshot 9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e of volume 0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] snapshot_file for this snap is: volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d76f8d-278f-4969-8007-9e6bcd7bea2d]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:10 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e Apr 10 13:25:10 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:10 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e" returned: 0 in 0.473s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0352529a-af8b-4163-93de-ae60580c7427(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efbc01e-b7b7-431f-b6c0-eacf0cc6a436]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:11 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 Apr 10 13:25:11 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:11 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427" returned: 0 in 0.473s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:11 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e Apr 10 13:25:11 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:11 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e" returned: 0 in 0.455s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:11 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e Apr 10 13:25:11 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:12 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427.9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e" returned: 0 in 0.402s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e" released by "_delete_snapshot" :: held 1.853s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-0352529a-af8b-4163-93de-ae60580c7427" released by "delete_snapshot" :: held 1.865s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Created reservations ['fba14d76-e913-4c79-bfec-1513dfe87da9', 'b74da501-153a-47d8-85d7-cb65cef7a47a', 'a3ba8609-e010-45da-8a29-f78ac9627d15', 'a0b0d378-fde8-4a39-a848-dc75be1b4c0d'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:12 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Delete snapshot completed successfully. Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7adcea89-08f9-4e2b-bb0b-7465731bdbe9 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-9a0b30bf-b14a-4c8a-9c03-98d45d05eb4e-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "cinder-0352529a-af8b-4163-93de-ae60580c7427-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-0352529a-af8b-4163-93de-ae60580c7427-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "cinder-quobyte-0352529a-af8b-4163-93de-ae60580c7427" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-0352529a-af8b-4163-93de-ae60580c7427" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6ac339-305a-48fb-803b-bc1399e175bf]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:12 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 Apr 10 13:25:12 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:13 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427" returned: 0 in 0.462s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:13 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427 Apr 10 13:25:13 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:13 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0352529a-af8b-4163-93de-ae60580c7427" returned: 0 in 0.407s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-0352529a-af8b-4163-93de-ae60580c7427" released by "delete_volume" :: held 0.894s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Created reservations ['04f12637-f236-4d38-98e5-a951a436a0bc', '449ae056-cf95-4a9e-a1db-ffe1f6013bff', 'c44f38f0-6ee2-47de-b0e2-4e401504e2d5', 'e67507cf-563a-4f3b-86e2-f3ec3978fc11'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:13 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:13 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "cinder-ded48931-3cb6-468a-9255-798c9fff1cfc-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-ded48931-3cb6-468a-9255-798c9fff1cfc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "cinder-quobyte-ded48931-3cb6-468a-9255-798c9fff1cfc" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-ded48931-3cb6-468a-9255-798c9fff1cfc" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e866dbce-af33-46d9-b983-3df5d66d0981]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:13 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc Apr 10 13:25:13 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:13 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.425s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:13 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Deleted volume successfully. Apr 10 13:25:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0bd78fae-e383-4f08-aa60-44723ec84b83 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-0352529a-af8b-4163-93de-ae60580c7427-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:14 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc" returned: 0 in 0.490s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:14 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc Apr 10 13:25:14 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:14 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ded48931-3cb6-468a-9255-798c9fff1cfc" returned: 0 in 0.427s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-quobyte-ded48931-3cb6-468a-9255-798c9fff1cfc" released by "delete_volume" :: held 0.947s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Created reservations ['e955071e-4554-48d9-a03e-7e8e52904e0e', 'fd83759e-d103-479d-adad-7b43427223ba', '6175f291-c0ac-4866-b126-8e5c2aca7b6d', '823aefaf-7dfb-41d6-95e0-ba98747db5b7'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:14 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:14 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:15 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.436s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:15 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:15 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Deleted volume successfully. Apr 10 13:25:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1d650ee8-fa6e-4274-bc58-0e23bdc2cf26 tempest-SnapshotDependencyTests-617390706 None] Lock "cinder-ded48931-3cb6-468a-9255-798c9fff1cfc-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:22 devstack cinder-volume[82554]: DEBUG oslo_service.periodic_task [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82554) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:25:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:22 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:22 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:23 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:23 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:24 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=23,cinder:UPDATE=31,cinder:DELETE=1,cinder:INSERT=10 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:25:25 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:UPDATE=26,cinder:SELECT=25,cinder:INSERT=4,cinder:DELETE=4 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (2b69ee94-765e-4205-83f3-f5201cf011be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b25c5ee-4e0c-4b14-b2f7-d118e6182df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b25c5ee-4e0c-4b14-b2f7-d118e6182df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-617039292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff1aa31-535d-4354-b821-2bcf5fa0da2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6667601f-7246-44cb-b076-5b9187e25e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6667601f-7246-44cb-b076-5b9187e25e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e44b91d-f54c-40d1-a87c-53de304097e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e44b91d-f54c-40d1-a87c-53de304097e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff1aa31-535d-4354-b821-2bcf5fa0da2a', 'volume_name': 'volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a018b132-a4cf-4682-b1ab-a7f6e7df293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a018b132-a4cf-4682-b1ab-a7f6e7df293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9c46e4-d441-488f-9968-4478f3449e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume 1ff1aa31-535d-4354-b821-2bcf5fa0da2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a', 'volume_size': 1} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-617039292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff1aa31-535d-4354-b821-2bcf5fa0da2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Creating volume 1ff1aa31-535d-4354-b821-2bcf5fa0da2a {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:26 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:26 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a 1073741824 Apr 10 13:25:26 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Flow 'volume_create_manager' (dedfab3c-2432-4f41-8ab7-62b1a83ae39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80385f64-a09f-4076-888b-2795976f8d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80385f64-a09f-4076-888b-2795976f8d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74f1d0b-d844-4327-a15b-40b257bb472c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735743a161448c19cdc9a19bb030a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='1437785e76654b9083c588c618e60105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b14eba-4d2b-48d6-8969-01245ea3ae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b14eba-4d2b-48d6-8969-01245ea3ae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d760c6b1-db3b-4f8c-9bc4-b66622d7857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d760c6b1-db3b-4f8c-9bc4-b66622d7857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c74f1d0b-d844-4327-a15b-40b257bb472c', 'volume_name': 'volume-c74f1d0b-d844-4327-a15b-40b257bb472c', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68271043-9082-4d28-9187-a81377d49613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68271043-9082-4d28-9187-a81377d49613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144ef1d4-d4c7-4794-a7b7-03fcc7555cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Volume c74f1d0b-d844-4327-a15b-40b257bb472c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c74f1d0b-d844-4327-a15b-40b257bb472c', 'volume_size': 1} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Flow 'volume_create_manager' (e23fbfb4-6ff1-4aee-9a4c-9823dddcad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e3aaf6-637e-4fb1-b65f-629f2dca91f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e3aaf6-637e-4fb1-b65f-629f2dca91f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1903778858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b269870e-46f0-472c-8dbc-d6fc89274d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ad0d34e4154629aea8ea982ccac2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='7dd9a421906546038ca6fa5e3c1d48fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577398ad-dc65-4b72-9cb4-4814ccf97d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577398ad-dc65-4b72-9cb4-4814ccf97d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dfdd7bc-900c-46fd-8da8-01f4df3df85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dfdd7bc-900c-46fd-8da8-01f4df3df85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b269870e-46f0-472c-8dbc-d6fc89274d56', 'volume_name': 'volume-b269870e-46f0-472c-8dbc-d6fc89274d56', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:26 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37eebd3b-8628-428a-8e03-0e5b8bdb81a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37eebd3b-8628-428a-8e03-0e5b8bdb81a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b69cae-3655-4bb1-8af4-d62042677bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Volume b269870e-46f0-472c-8dbc-d6fc89274d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b269870e-46f0-472c-8dbc-d6fc89274d56', 'volume_size': 1} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Flow 'volume_create_manager' (96c4d342-4478-4826-ba19-2c5f6138c490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e3b77b-391c-4408-8df1-124e04567d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e3b77b-391c-4408-8df1-124e04567d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1160785442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa96b3ab-8943-4c9e-af6a-1449d8807d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ea8e221c0f4823b92305354970ce06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='13e66befa6a2400f8483a5b123f33265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58311d0-39c8-4f19-91ed-65bad0635719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58311d0-39c8-4f19-91ed-65bad0635719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70abb8c5-1124-412a-8b49-f52d8b3922c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70abb8c5-1124-412a-8b49-f52d8b3922c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa96b3ab-8943-4c9e-af6a-1449d8807d1f', 'volume_name': 'volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc444b3-7814-49f2-8e0c-24e90e7b102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc444b3-7814-49f2-8e0c-24e90e7b102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e805887d-8593-46f5-8482-add839a09c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Volume aa96b3ab-8943-4c9e-af6a-1449d8807d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f', 'volume_size': 1} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Flow 'volume_create_manager' (7928f783-271a-4177-977a-d718dff82e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8688ff-65c0-4f8d-b0f1-cdde44b973b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8688ff-65c0-4f8d-b0f1-cdde44b973b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-129287157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aebd326-2672-4f49-8260-84550f76419a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ad0d34e4154629aea8ea982ccac2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='7dd9a421906546038ca6fa5e3c1d48fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032a6751-c53f-4ab2-8541-8831837643c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032a6751-c53f-4ab2-8541-8831837643c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0194bb-1980-404b-976f-f2f6629e0d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0194bb-1980-404b-976f-f2f6629e0d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aebd326-2672-4f49-8260-84550f76419a', 'volume_name': 'volume-3aebd326-2672-4f49-8260-84550f76419a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1932ad-50ff-4792-ada5-661c7a28c082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1932ad-50ff-4792-ada5-661c7a28c082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f070798-d28c-4767-a621-e7cf5a9e59b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Volume 3aebd326-2672-4f49-8260-84550f76419a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aebd326-2672-4f49-8260-84550f76419a', 'volume_size': 1} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Flow 'volume_create_manager' (ff80bb32-d0f7-4436-9221-3e3563a905d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7fb8b0-c1c8-427a-bca5-cde74172a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7fb8b0-c1c8-427a-bca5-cde74172a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1316305768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd73fef-0a91-49a7-85fd-2167fd065fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ad0d34e4154629aea8ea982ccac2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='7dd9a421906546038ca6fa5e3c1d48fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00956365-0b2c-46b7-9062-64a3e29f12a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00956365-0b2c-46b7-9062-64a3e29f12a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d5b41a-7ac8-49a5-b611-d5cd1f95898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d5b41a-7ac8-49a5-b611-d5cd1f95898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd73fef-0a91-49a7-85fd-2167fd065fd9', 'volume_name': 'volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534c5022-00d0-4281-9979-c52311882ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534c5022-00d0-4281-9979-c52311882ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba18c5b6-c613-4c09-8a42-ecce85f368c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Volume 0bd73fef-0a91-49a7-85fd-2167fd065fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9', 'volume_size': 1} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:27 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a 1073741824" returned: 0 in 0.652s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:27 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a Apr 10 13:25:27 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Flow 'volume_create_manager' (7da28806-6371-461f-9d1e-d0c4720e38f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e02825-50c9-4992-a0d3-50031b41b8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e02825-50c9-4992-a0d3-50031b41b8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1283114950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ad0d34e4154629aea8ea982ccac2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:28Z,use_quota=True,user_id='7dd9a421906546038ca6fa5e3c1d48fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75b2d42-9446-44d7-9bf4-9724292cb375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75b2d42-9446-44d7-9bf4-9724292cb375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc859e8-2eeb-40d3-bff9-14a94110cda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc859e8-2eeb-40d3-bff9-14a94110cda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079', 'volume_name': 'volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19daaa9f-f9d9-4d94-8f79-ab72e33a88a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19daaa9f-f9d9-4d94-8f79-ab72e33a88a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3ecde8-b69f-40ca-9869-b3af5441ade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Volume 6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079', 'volume_size': 1} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Flow 'volume_create_manager' (78f2c4f4-2339-47ea-9892-9ec72d14a30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa77c72b-d486-4223-a6ba-6e56efd2de5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa77c72b-d486-4223-a6ba-6e56efd2de5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1450539438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b14948-a82e-4217-a977-9ea85082fec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ad0d34e4154629aea8ea982ccac2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:28Z,use_quota=True,user_id='7dd9a421906546038ca6fa5e3c1d48fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a0f8ff-9706-44fa-8322-7b3059184f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a0f8ff-9706-44fa-8322-7b3059184f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55988c47-5038-45ab-8012-cb70edee5901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55988c47-5038-45ab-8012-cb70edee5901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0b14948-a82e-4217-a977-9ea85082fec6', 'volume_name': 'volume-e0b14948-a82e-4217-a977-9ea85082fec6', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb4b752-8185-4d97-a61a-66aa151b29ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb4b752-8185-4d97-a61a-66aa151b29ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca379fa0-05d0-4b9f-917b-45298ce5bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Volume e0b14948-a82e-4217-a977-9ea85082fec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0b14948-a82e-4217-a977-9ea85082fec6', 'volume_size': 1} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:27 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" returned: 0 in 0.484s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74f1d0b-d844-4327-a15b-40b257bb472c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735743a161448c19cdc9a19bb030a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='1437785e76654b9083c588c618e60105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Creating volume c74f1d0b-d844-4327-a15b-40b257bb472c {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:27 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9c46e4-d441-488f-9968-4478f3449e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:27 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c 1073741824 Apr 10 13:25:27 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb33a734-fd07-4307-811f-288ddab8ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:27 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a (1ff1aa31-535d-4354-b821-2bcf5fa0da2a): created successfully Apr 10 13:25:27 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb33a734-fd07-4307-811f-288ddab8ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (2b69ee94-765e-4205-83f3-f5201cf011be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:28 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-dd4d93b6-a79b-4042-b6c5-45f2dcba2f00 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created volume successfully. Apr 10 13:25:28 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c 1073741824" returned: 0 in 0.478s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:28 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c Apr 10 13:25:28 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:28 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c" returned: 0 in 0.420s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.882s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1903778858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b269870e-46f0-472c-8dbc-d6fc89274d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ad0d34e4154629aea8ea982ccac2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='7dd9a421906546038ca6fa5e3c1d48fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Creating volume b269870e-46f0-472c-8dbc-d6fc89274d56 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:28 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144ef1d4-d4c7-4794-a7b7-03fcc7555cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74f1d0b-d844-4327-a15b-40b257bb472c', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3eeae24-ff68-4be1-8b22-525522c8469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:28 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56 1073741824 Apr 10 13:25:28 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:28 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Volume volume-c74f1d0b-d844-4327-a15b-40b257bb472c (c74f1d0b-d844-4327-a15b-40b257bb472c): created successfully Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3eeae24-ff68-4be1-8b22-525522c8469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:28 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Flow 'volume_create_manager' (dedfab3c-2432-4f41-8ab7-62b1a83ae39e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:28 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a1374d55-cdc9-4053-a340-a0b7f8eee3d8 tempest-CinderUnicodeTest-1300789657 None] Created volume successfully. Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:29 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56 1073741824" returned: 0 in 0.497s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:29 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56 Apr 10 13:25:29 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:29 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56" returned: 0 in 0.419s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.747s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1160785442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa96b3ab-8943-4c9e-af6a-1449d8807d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ea8e221c0f4823b92305354970ce06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='13e66befa6a2400f8483a5b123f33265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Creating volume aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:29 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b69cae-3655-4bb1-8af4-d62042677bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b269870e-46f0-472c-8dbc-d6fc89274d56', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:29 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f 1073741824 Apr 10 13:25:29 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5032a6f1-53de-47b9-a78e-96ffbb28dfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:29 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Volume volume-b269870e-46f0-472c-8dbc-d6fc89274d56 (b269870e-46f0-472c-8dbc-d6fc89274d56): created successfully Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5032a6f1-53de-47b9-a78e-96ffbb28dfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:29 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Flow 'volume_create_manager' (e23fbfb4-6ff1-4aee-9a4c-9823dddcad4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:29 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-75340835-3b02-4d88-949d-f51b328095d4 tempest-CreateVolumesFromImageTest-606411376 None] Created volume successfully. Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Flow 'volume_create_manager' (6a0ec37e-2327-43c7-afe8-93cacefd38f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b50a563-7d47-41cb-9000-420f8ac86763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b50a563-7d47-41cb-9000-420f8ac86763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-66849102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4466552d-0e9e-45c8-8693-607feb51692c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735743a161448c19cdc9a19bb030a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:30Z,use_quota=True,user_id='1437785e76654b9083c588c618e60105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ad2ef1-81c1-4224-9a74-da6439c8666f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ad2ef1-81c1-4224-9a74-da6439c8666f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba167633-f5bb-4fd2-afe6-d9ffb97b99e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:30 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba167633-f5bb-4fd2-afe6-d9ffb97b99e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4466552d-0e9e-45c8-8693-607feb51692c', 'volume_name': 'volume-4466552d-0e9e-45c8-8693-607feb51692c', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ff9d50-7737-414a-88b5-b678b563257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ff9d50-7737-414a-88b5-b678b563257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15aba419-3308-4e44-b14d-579793448ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:30 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Volume 4466552d-0e9e-45c8-8693-607feb51692c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4466552d-0e9e-45c8-8693-607feb51692c', 'volume_size': 1} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f 1073741824" returned: 0 in 0.543s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:30 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f Apr 10 13:25:30 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:30 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" returned: 0 in 0.415s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.621s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-129287157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aebd326-2672-4f49-8260-84550f76419a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ad0d34e4154629aea8ea982ccac2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='7dd9a421906546038ca6fa5e3c1d48fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Creating volume 3aebd326-2672-4f49-8260-84550f76419a {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:30 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e805887d-8593-46f5-8482-add839a09c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:30 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a 1073741824 Apr 10 13:25:30 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743ec898-4b15-4463-ada5-da7a6c49bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:30 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Volume volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f (aa96b3ab-8943-4c9e-af6a-1449d8807d1f): created successfully Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743ec898-4b15-4463-ada5-da7a6c49bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:30 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Flow 'volume_create_manager' (96c4d342-4478-4826-ba19-2c5f6138c490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:30 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7f87dfcc-79f9-4f1f-ab90-0c773989dd1e tempest-VolumeDependencyTests-799528399 None] Created volume successfully. Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:31 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a 1073741824" returned: 0 in 0.501s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:31 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a Apr 10 13:25:31 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:31 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a" returned: 0 in 0.398s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.357s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1316305768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd73fef-0a91-49a7-85fd-2167fd065fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ad0d34e4154629aea8ea982ccac2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:27Z,use_quota=True,user_id='7dd9a421906546038ca6fa5e3c1d48fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Creating volume 0bd73fef-0a91-49a7-85fd-2167fd065fd9 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:31 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f070798-d28c-4767-a621-e7cf5a9e59b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aebd326-2672-4f49-8260-84550f76419a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e71ebf8-4fc6-435b-861e-ca89ff1f1626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:31 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9 1073741824 Apr 10 13:25:31 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:31 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Volume volume-3aebd326-2672-4f49-8260-84550f76419a (3aebd326-2672-4f49-8260-84550f76419a): created successfully Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e71ebf8-4fc6-435b-861e-ca89ff1f1626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:31 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Flow 'volume_create_manager' (7928f783-271a-4177-977a-d718dff82e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:31 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0a091324-28fb-44c0-bc03-f93c42e20cb5 tempest-CreateVolumesFromImageTest-606411376 None] Created volume successfully. Apr 10 13:25:32 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9 1073741824" returned: 0 in 0.503s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:32 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9 Apr 10 13:25:32 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:32 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9" returned: 0 in 0.413s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.115s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1283114950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ad0d34e4154629aea8ea982ccac2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:28Z,use_quota=True,user_id='7dd9a421906546038ca6fa5e3c1d48fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Creating volume 6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:32 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba18c5b6-c613-4c09-8a42-ecce85f368c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75dc076b-6d31-4c37-86fa-3fd7154a23ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:32 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 1073741824 Apr 10 13:25:32 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:32 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Volume volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9 (0bd73fef-0a91-49a7-85fd-2167fd065fd9): created successfully Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75dc076b-6d31-4c37-86fa-3fd7154a23ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:32 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Flow 'volume_create_manager' (ff80bb32-d0f7-4436-9221-3e3563a905d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:32 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-f16b1ba3-b60a-4e45-9ae3-803b327f9e48 tempest-CreateVolumesFromImageTest-606411376 None] Created volume successfully. Apr 10 13:25:33 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 1073741824" returned: 0 in 0.489s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:33 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 Apr 10 13:25:33 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:33 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079" returned: 0 in 0.411s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.860s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1450539438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b14948-a82e-4217-a977-9ea85082fec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ad0d34e4154629aea8ea982ccac2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:28Z,use_quota=True,user_id='7dd9a421906546038ca6fa5e3c1d48fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Creating volume e0b14948-a82e-4217-a977-9ea85082fec6 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:33 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:33 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6 1073741824 Apr 10 13:25:33 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3ecde8-b69f-40ca-9869-b3af5441ade8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7f0260-f251-450b-8507-063f67743958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:33 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Volume volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 (6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079): created successfully Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7f0260-f251-450b-8507-063f67743958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:33 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Flow 'volume_create_manager' (7da28806-6371-461f-9d1e-d0c4720e38f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:33 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-fae2d088-256e-4456-940e-51c5374498c9 tempest-CreateVolumesFromImageTest-606411376 None] Created volume successfully. Apr 10 13:25:34 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6 1073741824" returned: 0 in 0.523s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:34 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6 Apr 10 13:25:34 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:34 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6" returned: 0 in 0.416s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.493s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca379fa0-05d0-4b9f-917b-45298ce5bac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b14948-a82e-4217-a977-9ea85082fec6', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46129525-30eb-4266-9465-762f6aa478a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Creating offline snapshot c3693add-7977-4549-abdb-8b7c39d6e783 of volume 1ff1aa31-535d-4354-b821-2bcf5fa0da2a {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:25:34 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Volume volume-e0b14948-a82e-4217-a977-9ea85082fec6 (e0b14948-a82e-4217-a977-9ea85082fec6): created successfully Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46129525-30eb-4266-9465-762f6aa478a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Flow 'volume_create_manager' (78f2c4f4-2339-47ea-9892-9ec72d14a30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[98618722-9b34-401c-8804-ca9cf0925fb1]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:34 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:34 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-11e20998-ae6c-4cda-9d53-b658a7f968a6 tempest-CreateVolumesFromImageTest-606411376 None] Created volume successfully. Apr 10 13:25:34 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a Apr 10 13:25:34 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:35 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" returned: 0 in 0.472s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:35 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 1G Apr 10 13:25:35 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "cinder-e0b14948-a82e-4217-a977-9ea85082fec6-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-e0b14948-a82e-4217-a977-9ea85082fec6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "cinder-quobyte-e0b14948-a82e-4217-a977-9ea85082fec6" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-quobyte-e0b14948-a82e-4217-a977-9ea85082fec6" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c94c1-bd12-43f1-b4ea-3bb54c6f088e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:35 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6 Apr 10 13:25:35 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:35 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 1G" returned: 0 in 0.483s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:35 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 Apr 10 13:25:35 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:35 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6" returned: 0 in 0.509s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:35 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:35 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6 Apr 10 13:25:35 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:36 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783" returned: 0 in 0.428s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:36 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 is being set with open permissions: ugo+rw Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:36 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 Apr 10 13:25:36 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:36 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-e0b14948-a82e-4217-a977-9ea85082fec6" returned: 0 in 0.406s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-quobyte-e0b14948-a82e-4217-a977-9ea85082fec6" released by "delete_volume" :: held 0.941s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Created reservations ['91beea64-19b3-418f-a07d-0ba71ff015af', 'c68650d9-c0e5-4d89-bfc8-060464a85ac7', 'ea7809a8-99e8-4d40-b01a-aae33f85a280', '15dc7a5b-9c38-47b4-8bab-802ce43fd74e'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:36 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:36 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "cinder-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "cinder-quobyte-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-quobyte-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad028b25-9a69-45d3-a3e4-17900844101e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:36 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783" returned: 0 in 0.465s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:36 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 Apr 10 13:25:36 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:36 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.info Apr 10 13:25:36 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:36 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.472s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:36 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Deleted volume successfully. Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c947977b-f5d9-4340-899f-f85ae9613919 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-e0b14948-a82e-4217-a977-9ea85082fec6-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:36 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079" returned: 0 in 0.485s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:36 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079 Apr 10 13:25:36 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:36 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.info" returned: 0 in 0.441s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:36 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.info is being set with open permissions: ugo+rw Apr 10 13:25:36 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:36 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.info Apr 10 13:25:36 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:37 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079" returned: 0 in 0.414s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:37 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-quobyte-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079" released by "delete_volume" :: held 0.921s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.info" returned: 0 in 0.407s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.773s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.995s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-66849102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4466552d-0e9e-45c8-8693-607feb51692c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6735743a161448c19cdc9a19bb030a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:30Z,use_quota=True,user_id='1437785e76654b9083c588c618e60105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Creating volume 4466552d-0e9e-45c8-8693-607feb51692c {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:37 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:37 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c 1073741824 Apr 10 13:25:37 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:37 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-cb946046-dd9c-467c-a2e2-3b84ea255398 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Create snapshot completed successfully Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Created reservations ['6f39bf64-4c53-427c-bc1d-711afe6c2524', '2b2cf991-3857-4cd0-bab2-b0b9a0d6e33b', 'd5f973fa-7b10-4d7c-8f46-9c11520bee13', 'a6411010-c9f5-4493-8e24-9952c7470fec'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:37 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:37 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:37 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c 1073741824" returned: 0 in 0.487s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:37 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c Apr 10 13:25:37 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:37 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.436s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:37 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Deleted volume successfully. Apr 10 13:25:37 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-7b0db974-986b-4eea-be38-7bbbc562f820 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-6a5d0ec1-6cc2-4a34-a3fc-d3abb9877079-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:38 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c" returned: 0 in 0.404s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.013s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15aba419-3308-4e44-b14d-579793448ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4466552d-0e9e-45c8-8693-607feb51692c', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e33c55d-8128-47a1-8c5e-334edc49b3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Creating offline snapshot 4619a86a-84b3-4814-8c45-511ecb8212c8 of volume aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:25:38 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Volume volume-4466552d-0e9e-45c8-8693-607feb51692c (4466552d-0e9e-45c8-8693-607feb51692c): created successfully Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e33c55d-8128-47a1-8c5e-334edc49b3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Flow 'volume_create_manager' (6a0ec37e-2327-43c7-afe8-93cacefd38f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98ab86e-83f3-4f22-bf22-6577f5dd0331]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:38 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a37baf1d-aa2c-4302-b095-b7793e383db9 tempest-CinderUnicodeTest-1300789657 None] Created volume successfully. Apr 10 13:25:38 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f Apr 10 13:25:38 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "cinder-0bd73fef-0a91-49a7-85fd-2167fd065fd9-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-0bd73fef-0a91-49a7-85fd-2167fd065fd9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "cinder-quobyte-0bd73fef-0a91-49a7-85fd-2167fd065fd9" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-quobyte-0bd73fef-0a91-49a7-85fd-2167fd065fd9" acquired by "delete_volume" :: waited 0.046s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (284a4525-0f64-4ab6-948c-172cc1eccd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621cddbb-ee48-4f34-afcd-7248b385d8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ee31f8-825f-4421-b1a8-ccaf846ad4fa]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621cddbb-ee48-4f34-afcd-7248b385d8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2117859180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b5a5fd-9381-4dac-b81b-513cef2a1054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:39Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f12b97-a0ba-4876-84ec-f4bc591e98c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f12b97-a0ba-4876-84ec-f4bc591e98c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61858dc-2b58-4da8-8da2-215ce6e0e5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61858dc-2b58-4da8-8da2-215ce6e0e5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b5a5fd-9381-4dac-b81b-513cef2a1054', 'volume_name': 'volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925ec7f8-59b2-410a-b63b-bf98de6395f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925ec7f8-59b2-410a-b63b-bf98de6395f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04ce624-338e-4d40-8c80-ff0ef9b248c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:38 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume d2b5a5fd-9381-4dac-b81b-513cef2a1054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054', 'volume_size': 1} Apr 10 13:25:38 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:38 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9 Apr 10 13:25:38 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:39 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" returned: 0 in 0.696s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:39 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 1G Apr 10 13:25:39 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (10c2788e-69d1-4662-8e5c-4126dd02e053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e67b435-1763-492d-b875-62d673864f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e67b435-1763-492d-b875-62d673864f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040085474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d3e8b7-2be8-4e5d-bc8e-046cd3652264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:39Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09554f5e-04ee-4b87-a67f-c2fae49af6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09554f5e-04ee-4b87-a67f-c2fae49af6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52cc9a9d-72b3-4ea4-a2f4-ab1b8463bea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52cc9a9d-72b3-4ea4-a2f4-ab1b8463bea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d3e8b7-2be8-4e5d-bc8e-046cd3652264', 'volume_name': 'volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87296529-10ab-4faf-8748-96ffaa2c5e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87296529-10ab-4faf-8748-96ffaa2c5e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7002508f-c36b-4513-b1eb-8571d8e3c0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume 99d3e8b7-2be8-4e5d-bc8e-046cd3652264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264', 'volume_size': 1} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (0a91e530-dad4-4a2d-83af-aeea3ee66541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71777daa-94c2-4cf6-b25b-22d43c07813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71777daa-94c2-4cf6-b25b-22d43c07813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836714752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:39Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7809e5c4-af96-4ff4-97b0-9d4b99086c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7809e5c4-af96-4ff4-97b0-9d4b99086c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f812fd-f8f0-42b0-a537-1289758cc2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f812fd-f8f0-42b0-a537-1289758cc2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98', 'volume_name': 'volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda93e3c-f4e7-4fe9-9def-60d4e95761fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda93e3c-f4e7-4fe9-9def-60d4e95761fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea7440e-2a37-4ccf-a423-ad1c191453d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98', 'volume_size': 1} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:39 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (f09d8238-5384-4721-b79d-e7592bcc3bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583200c2-8d67-452d-8c30-e71175a882e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9" returned: 0 in 0.790s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583200c2-8d67-452d-8c30-e71175a882e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-878235632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4ac3d4-742f-4470-a3cf-a73687aaf81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:39Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9f2dfa-940b-46af-9240-88dd929e63cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9 Apr 10 13:25:39 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9f2dfa-940b-46af-9240-88dd929e63cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d09b82-a6b7-487f-bbf2-9edca26206e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d09b82-a6b7-487f-bbf2-9edca26206e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4ac3d4-742f-4470-a3cf-a73687aaf81b', 'volume_name': 'volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f8e923-e305-4fd9-880f-b78ec2b832df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f8e923-e305-4fd9-880f-b78ec2b832df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a675c0d-3e7a-4c45-a731-5f8a3bf2d919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume 7c4ac3d4-742f-4470-a3cf-a73687aaf81b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b', 'volume_size': 1} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:39 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 1G" returned: 0 in 0.588s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:39 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 Apr 10 13:25:39 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (10cd8e68-9da7-4da6-a60e-2a84613586ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e182a7db-cd0b-4186-9508-1c7fe36e6812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e182a7db-cd0b-4186-9508-1c7fe36e6812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2097306847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908ab05a-d906-46a2-a667-05c2c1241037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:40Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b024e471-eb09-46ab-848d-baff15701f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b024e471-eb09-46ab-848d-baff15701f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b900bdfd-e98d-40d9-8bf9-46ddc0245cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b900bdfd-e98d-40d9-8bf9-46ddc0245cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908ab05a-d906-46a2-a667-05c2c1241037', 'volume_name': 'volume-908ab05a-d906-46a2-a667-05c2c1241037', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8021fa1-62fb-469d-8155-829f3fa19941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8021fa1-62fb-469d-8155-829f3fa19941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964e5a67-5040-45ee-b6e7-086e621339b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:39 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume 908ab05a-d906-46a2-a667-05c2c1241037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908ab05a-d906-46a2-a667-05c2c1241037', 'volume_size': 1} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:39 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-0bd73fef-0a91-49a7-85fd-2167fd065fd9" returned: 0 in 0.449s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:39 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-quobyte-0bd73fef-0a91-49a7-85fd-2167fd065fd9" released by "delete_volume" :: held 1.311s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Created reservations ['f969c271-9307-4328-aa69-10655c109085', 'ff62bd0c-3009-4895-b2ef-f0d897df092f', 'c0307c1f-80ca-43ed-aeeb-56410f05f853', 'b8ebc893-b65b-47ca-9b73-c88867bec8b2'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:40 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:40 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:40 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8" returned: 0 in 0.479s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:40 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 is being set with open permissions: ugo+rw Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:40 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 Apr 10 13:25:40 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:40 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.422s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:40 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Deleted volume successfully. Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-d7e1b154-3b06-4031-9094-d15c14b121a9 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-0bd73fef-0a91-49a7-85fd-2167fd065fd9-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:40 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8" returned: 0 in 0.423s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:40 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.info Apr 10 13:25:40 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "cinder-3aebd326-2672-4f49-8260-84550f76419a-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-3aebd326-2672-4f49-8260-84550f76419a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "cinder-quobyte-3aebd326-2672-4f49-8260-84550f76419a" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-quobyte-3aebd326-2672-4f49-8260-84550f76419a" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9a7e2e-3350-47e2-b538-3c79c0958555]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:40 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:40 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a Apr 10 13:25:40 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:41 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.info" returned: 0 in 0.437s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:41 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.info is being set with open permissions: ugo+rw Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:41 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.info Apr 10 13:25:41 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:41 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a" returned: 0 in 0.472s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:41 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a Apr 10 13:25:41 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:41 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.info" returned: 0 in 0.417s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.124s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.637s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2117859180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b5a5fd-9381-4dac-b81b-513cef2a1054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:39Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Creating volume d2b5a5fd-9381-4dac-b81b-513cef2a1054 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:41 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:41 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054 1073741824 Apr 10 13:25:41 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:41 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8a360bec-1c5e-4712-848b-fe9ccd91a88f tempest-VolumeDependencyTests-799528399 None] Create snapshot completed successfully Apr 10 13:25:41 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-3aebd326-2672-4f49-8260-84550f76419a" returned: 0 in 0.482s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-quobyte-3aebd326-2672-4f49-8260-84550f76419a" released by "delete_volume" :: held 0.992s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Created reservations ['ebc0f108-8b92-4524-9bd2-016e7ca42129', '25c13c49-ebbe-4dab-ba04-a07a51e2094f', '4c3b2f2b-c654-40a7-a352-4e48ad7f136e', '35ddbdd3-5065-4f92-b9d0-a91614f7bbe2'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Flow 'volume_create_manager' (385ab167-15ac-465b-a3a8-33eb580e30fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1987c8cd-108c-4dea-b37d-06b0b0445179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:41 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1987c8cd-108c-4dea-b37d-06b0b0445179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-987151460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c86e0d9-6ce5-4590-9229-e45b0a84af82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ea8e221c0f4823b92305354970ce06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4619a86a-84b3-4814-8c45-511ecb8212c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:42Z,use_quota=True,user_id='13e66befa6a2400f8483a5b123f33265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ae0862-60a3-46c4-9b9c-147809ad31e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:41 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ae0862-60a3-46c4-9b9c-147809ad31e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bacedebe-a781-479c-8f84-3425b80e1714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bacedebe-a781-479c-8f84-3425b80e1714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c86e0d9-6ce5-4590-9229-e45b0a84af82', 'volume_name': 'volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82', 'volume_size': 1, 'snapshot_id': '4619a86a-84b3-4814-8c45-511ecb8212c8'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb0b1db-cef9-4e36-a2d3-41585a5ad818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb0b1db-cef9-4e36-a2d3-41585a5ad818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c816d6-ec52-4900-9b82-500c67fcbecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:42 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Volume 8c86e0d9-6ce5-4590-9229-e45b0a84af82: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82', 'volume_size': 1, 'snapshot_id': '4619a86a-84b3-4814-8c45-511ecb8212c8'} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054 1073741824" returned: 0 in 0.574s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:42 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:42 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:42 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054 Apr 10 13:25:42 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:42 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.403s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:42 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Deleted volume successfully. Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-90444d91-08a3-49ab-8c62-3fb111f1fd9e tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-3aebd326-2672-4f49-8260-84550f76419a-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:42 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054" returned: 0 in 0.416s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.328s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040085474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d3e8b7-2be8-4e5d-bc8e-046cd3652264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:39Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Creating volume 99d3e8b7-2be8-4e5d-bc8e-046cd3652264 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:42 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04ce624-338e-4d40-8c80-ff0ef9b248c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a37fb1f-6e38-415f-bbf7-87dde562113a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:42 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264 1073741824 Apr 10 13:25:42 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:42 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054 (d2b5a5fd-9381-4dac-b81b-513cef2a1054): created successfully Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a37fb1f-6e38-415f-bbf7-87dde562113a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (284a4525-0f64-4ab6-948c-172cc1eccd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:42 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ff7fd5e8-e924-496b-975a-f9394dee8dd9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created volume successfully. Apr 10 13:25:42 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "cinder-b269870e-46f0-472c-8dbc-d6fc89274d56-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-b269870e-46f0-472c-8dbc-d6fc89274d56-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "cinder-quobyte-b269870e-46f0-472c-8dbc-d6fc89274d56" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-quobyte-b269870e-46f0-472c-8dbc-d6fc89274d56" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df0c482-43cc-45fe-ac85-0eb5b46f9644]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:43 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264 1073741824" returned: 0 in 0.573s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:43 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264 Apr 10 13:25:43 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:43 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56 Apr 10 13:25:43 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:43 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264" returned: 0 in 0.427s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.363s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:43 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7002508f-c36b-4513-b1eb-8571d8e3c0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704a5b29-bd0a-41a8-b31d-14eceeae76d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56" returned: 0 in 0.487s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Creating offline snapshot ed4df372-1742-4b4b-8cca-f281ff1417be of volume 4466552d-0e9e-45c8-8693-607feb51692c {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:25:43 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264 (99d3e8b7-2be8-4e5d-bc8e-046cd3652264): created successfully Apr 10 13:25:43 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56 Apr 10 13:25:43 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704a5b29-bd0a-41a8-b31d-14eceeae76d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (10c2788e-69d1-4662-8e5c-4126dd02e053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[243828ca-63fe-4bc8-9b86-b939dc109894]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:43 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-3dcdc1fa-9705-483f-86f6-d8b0942be238 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created volume successfully. Apr 10 13:25:43 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c Apr 10 13:25:43 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:43 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-b269870e-46f0-472c-8dbc-d6fc89274d56" returned: 0 in 0.446s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:43 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-quobyte-b269870e-46f0-472c-8dbc-d6fc89274d56" released by "delete_volume" :: held 0.958s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Created reservations ['6180bc4b-8a75-4d54-a67e-a1816c4f34c0', 'e27295d1-19ee-40e2-9947-1a90eacee41c', 'bcd8e983-4f28-4c8c-bfd5-a15e7847379c', '1f6ce14a-b393-4e8d-a0c5-f2f86a5984a5'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:44 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c" returned: 0 in 0.497s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:44 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be 1G Apr 10 13:25:44 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:44 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:44 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:44 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.481s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:44 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Deleted volume successfully. Apr 10 13:25:44 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-25c79961-5b8c-495f-89ca-f223ee818246 tempest-CreateVolumesFromImageTest-606411376 None] Lock "cinder-b269870e-46f0-472c-8dbc-d6fc89274d56-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be 1G" returned: 0 in 0.539s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:44 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4466552d-0e9e-45c8-8693-607feb51692c -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:44 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4466552d-0e9e-45c8-8693-607feb51692c -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be Apr 10 13:25:44 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:45 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4466552d-0e9e-45c8-8693-607feb51692c -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be" returned: 0 in 0.495s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:45 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be is being set with open permissions: ugo+rw Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:45 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be Apr 10 13:25:45 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:45 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be" returned: 0 in 0.437s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:45 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.info Apr 10 13:25:45 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (2530d454-e38e-44eb-a0f0-c0abebfc6b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c313b334-e683-410a-9ac7-840d73c9a2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c313b334-e683-410a-9ac7-840d73c9a2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1582972036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8fa251-c5e0-4145-b1e3-0b021f638e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:46Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d04a6e-d723-4b2e-a38f-82b6ecfecb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d04a6e-d723-4b2e-a38f-82b6ecfecb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ab1f44-302a-4815-bffc-9e65ff009b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ab1f44-302a-4815-bffc-9e65ff009b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8fa251-c5e0-4145-b1e3-0b021f638e0e', 'volume_name': 'volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2629ba5d-21e1-413e-834f-88e9be0e5519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2629ba5d-21e1-413e-834f-88e9be0e5519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5552bb93-8e54-4da9-87f1-c54b15bc9bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:45 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume ad8fa251-c5e0-4145-b1e3-0b021f638e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e', 'volume_size': 1} Apr 10 13:25:45 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:46 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.info" returned: 0 in 0.468s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:46 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.info is being set with open permissions: ugo+rw Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:46 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.info Apr 10 13:25:46 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:46 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.info" returned: 0 in 0.410s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.934s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.130s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836714752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:39Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Creating volume a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:46 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:46 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 1073741824 Apr 10 13:25:46 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:46 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c9eb5ede-8c6c-4abf-9944-97e621019660 tempest-CinderUnicodeTest-1300789657 None] Create snapshot completed successfully Apr 10 13:25:46 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 1073741824" returned: 0 in 0.485s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:46 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:46 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 Apr 10 13:25:46 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "cinder-ed4df372-1742-4b4b-8cca-f281ff1417be-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-ed4df372-1742-4b4b-8cca-f281ff1417be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "cinder-quobyte-4466552d-0e9e-45c8-8693-607feb51692c" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-quobyte-4466552d-0e9e-45c8-8693-607feb51692c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "cinder-quobyte-ed4df372-1742-4b4b-8cca-f281ff1417be" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-quobyte-ed4df372-1742-4b4b-8cca-f281ff1417be" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Deleting offline snapshot ed4df372-1742-4b4b-8cca-f281ff1417be of volume 4466552d-0e9e-45c8-8693-607feb51692c {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] snapshot_file for this snap is: volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7044bfd-21e9-4aad-94c0-fa761eaa568f]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:47 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98" returned: 0 in 0.455s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.841s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-878235632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4ac3d4-742f-4470-a3cf-a73687aaf81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:39Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Creating volume 7c4ac3d4-742f-4470-a3cf-a73687aaf81b {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:47 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:47 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be Apr 10 13:25:47 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea7440e-2a37-4ccf-a423-ad1c191453d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28013a0a-e578-420c-9677-67dcd37faab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:47 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b 1073741824 Apr 10 13:25:47 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:47 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 (a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98): created successfully Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28013a0a-e578-420c-9677-67dcd37faab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (0a91e530-dad4-4a2d-83af-aeea3ee66541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:47 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1eaee82a-b669-4c66-be35-a2fe6d34b5df tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created volume successfully. Apr 10 13:25:47 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be" returned: 0 in 0.486s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4466552d-0e9e-45c8-8693-607feb51692c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f51ba-3847-43a4-9ae4-1f2c0e3c340b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:47 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b 1073741824" returned: 0 in 0.512s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:47 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c Apr 10 13:25:47 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:47 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:47 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b Apr 10 13:25:47 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:48 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c" returned: 0 in 0.489s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:48 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be Apr 10 13:25:48 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:48 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b" returned: 0 in 0.428s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.579s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2097306847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908ab05a-d906-46a2-a667-05c2c1241037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4317ceb3b240dcb3728d46182ef83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:40Z,use_quota=True,user_id='67fb4cdbccc44dd8b00a4173d302c057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Creating volume 908ab05a-d906-46a2-a667-05c2c1241037 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:48 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a675c0d-3e7a-4c45-a731-5f8a3bf2d919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6f3b26-3b04-4b49-8f20-ef961dcc9ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:48 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037 1073741824 Apr 10 13:25:48 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:48 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b (7c4ac3d4-742f-4470-a3cf-a73687aaf81b): created successfully Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6f3b26-3b04-4b49-8f20-ef961dcc9ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (f09d8238-5384-4721-b79d-e7592bcc3bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:48 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7da285a8-a33c-4fd1-907a-4ae8f794774a tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created volume successfully. Apr 10 13:25:48 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be" returned: 0 in 0.472s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:48 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be Apr 10 13:25:48 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:48 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037 1073741824" returned: 0 in 0.503s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:48 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:48 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037 Apr 10 13:25:48 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:49 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c.ed4df372-1742-4b4b-8cca-f281ff1417be" returned: 0 in 0.406s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-quobyte-ed4df372-1742-4b4b-8cca-f281ff1417be" released by "_delete_snapshot" :: held 1.908s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-quobyte-4466552d-0e9e-45c8-8693-607feb51692c" released by "delete_snapshot" :: held 1.919s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Created reservations ['5b43ced3-d45a-456f-a47f-98602defb3c7', '9b525356-4692-4186-a955-bb7fcedf311a', '0b1bad94-2f94-4fa0-90e6-42209910bdd1', 'f36e656a-52f4-42b1-82a5-ed160a9baeb1'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:49 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037" returned: 0 in 0.424s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.326s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-quobyte-4619a86a-84b3-4814-8c45-511ecb8212c8-8c86e0d9-6ce5-4590-9229-e45b0a84af82" by "_create_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964e5a67-5040-45ee-b6e7-086e621339b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908ab05a-d906-46a2-a667-05c2c1241037', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489de27d-33d1-4d00-b1b6-05a1c4b022ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-4619a86a-84b3-4814-8c45-511ecb8212c8-8c86e0d9-6ce5-4590-9229-e45b0a84af82" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Creating volume 8c86e0d9-6ce5-4590-9229-e45b0a84af82 from snapshot 4619a86a-84b3-4814-8c45-511ecb8212c8 {{(pid=82554) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-quobyte-8c86e0d9-6ce5-4590-9229-e45b0a84af82" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:49 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Volume volume-908ab05a-d906-46a2-a667-05c2c1241037 (908ab05a-d906-46a2-a667-05c2c1241037): created successfully Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489de27d-33d1-4d00-b1b6-05a1c4b022ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Flow 'volume_create_manager' (10cd8e68-9da7-4da6-a60e-2a84613586ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:49 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8ef6c7f3-b931-45f8-a012-0eb7817d4f6d tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created volume successfully. Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-8c86e0d9-6ce5-4590-9229-e45b0a84af82" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] snapshot: 4619a86a-84b3-4814-8c45-511ecb8212c8, volume: 8c86e0d9-6ce5-4590-9229-e45b0a84af82, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:25:49 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Delete snapshot completed successfully. Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c9c42b52-0f4e-4f95-a4f8-cb2387158e4c tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-ed4df372-1742-4b4b-8cca-f281ff1417be-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75b977e-8bdf-4c4c-b175-bdc62a398887]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "cinder-4466552d-0e9e-45c8-8693-607feb51692c-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-4466552d-0e9e-45c8-8693-607feb51692c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "cinder-quobyte-4466552d-0e9e-45c8-8693-607feb51692c" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-quobyte-4466552d-0e9e-45c8-8693-607feb51692c" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d93956-d697-48d0-aed1-938e3f8a6742]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:49 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 Apr 10 13:25:49 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:49 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c Apr 10 13:25:49 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:49 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8" returned: 0 in 0.494s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e7d17b-6848-4d59-b228-07a63f59e430]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:49 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:50 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c" returned: 0 in 0.480s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:50 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c Apr 10 13:25:50 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:50 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f Apr 10 13:25:50 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:50 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-4466552d-0e9e-45c8-8693-607feb51692c" returned: 0 in 0.419s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-quobyte-4466552d-0e9e-45c8-8693-607feb51692c" released by "delete_volume" :: held 0.925s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:50 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" returned: 0 in 0.507s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-908ab05a-d906-46a2-a667-05c2c1241037-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:50 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 Apr 10 13:25:50 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Created reservations ['702e3e00-d0a2-41fe-a5ae-1decf0055cc8', 'b49716c8-b509-47c2-b801-623224fe5839', 'df95cbb7-4fc9-422f-8b26-b8577c33c2d5', '28294e37-defb-48f6-a86c-7a07180f80e3'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-908ab05a-d906-46a2-a667-05c2c1241037-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-quobyte-908ab05a-d906-46a2-a667-05c2c1241037" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-908ab05a-d906-46a2-a667-05c2c1241037" acquired by "delete_volume" :: waited 0.028s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:50 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:50 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[251fa8e2-59a1-4759-8e99-c9ddebfcce33]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "cinder-c74f1d0b-d844-4327-a15b-40b257bb472c-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-c74f1d0b-d844-4327-a15b-40b257bb472c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "cinder-quobyte-c74f1d0b-d844-4327-a15b-40b257bb472c" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-quobyte-c74f1d0b-d844-4327-a15b-40b257bb472c" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[330d160f-cd06-4979-a4e3-af90ecaeb6e7]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:50 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:50 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037 Apr 10 13:25:50 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:50 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c Apr 10 13:25:50 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:51 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037" returned: 0 in 0.677s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:51 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.729s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:51 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037 Apr 10 13:25:51 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:51 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:51 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Deleted volume successfully. Apr 10 13:25:51 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a066f330-588e-45c4-8480-ce168540d18c tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-4466552d-0e9e-45c8-8693-607feb51692c-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:51 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c" returned: 0 in 1.306s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:51 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:52 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c Apr 10 13:25:52 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:52 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-908ab05a-d906-46a2-a667-05c2c1241037" returned: 0 in 0.845s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-908ab05a-d906-46a2-a667-05c2c1241037" released by "delete_volume" :: held 1.561s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created reservations ['c2400844-2bda-4d0c-a9d5-a0dc0f36c119', '3c046d23-91ff-4da1-bc70-0627aabcacca', '2f1e077b-013b-4f72-99c4-99d68a9e0559', 'f8ce96ee-9413-45f4-8e05-0ced3890e83d'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:52 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:52 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-7c4ac3d4-742f-4470-a3cf-a73687aaf81b-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-7c4ac3d4-742f-4470-a3cf-a73687aaf81b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-quobyte-7c4ac3d4-742f-4470-a3cf-a73687aaf81b" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-7c4ac3d4-742f-4470-a3cf-a73687aaf81b" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca67b4-4bbf-407f-8d93-11a8410ae732]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:52 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82" returned: 0 in 2.441s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[488ddcee-d205-448f-85d6-31ac1b47804c]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:52 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b Apr 10 13:25:52 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:52 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-c74f1d0b-d844-4327-a15b-40b257bb472c" returned: 0 in 0.996s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:52 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-quobyte-c74f1d0b-d844-4327-a15b-40b257bb472c" released by "delete_volume" :: held 2.331s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:53 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f Apr 10 13:25:53 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Created reservations ['43cd5175-9fc6-4b3a-81ff-07eb7ef5dfd8', '5be1c6c7-fb63-4d0f-8795-8e36a72cdb22', '2e691851-0107-4fcb-a639-f67241f63727', 'fe3c2104-0a56-4510-a291-2a167af11c67'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:53 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:53 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:53 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.707s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:53 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Deleted volume successfully. Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-61bd7d5f-9874-4738-9130-40f3eee4fc15 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-908ab05a-d906-46a2-a667-05c2c1241037-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:53 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b" returned: 0 in 0.537s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:53 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b Apr 10 13:25:53 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:53 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.450s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:53 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Deleted volume successfully. Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad5a7aaf-0df8-44a7-91dd-1b77176360da tempest-CinderUnicodeTest-1300789657 None] Lock "cinder-c74f1d0b-d844-4327-a15b-40b257bb472c-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:53 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" returned: 0 in 0.658s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:25:53 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Converted 1024.00 MB image at 419.36 MB/s Apr 10 13:25:53 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 is being set with open permissions: ugo+rw Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:53 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 Apr 10 13:25:53 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:53 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7c4ac3d4-742f-4470-a3cf-a73687aaf81b" returned: 0 in 0.420s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-7c4ac3d4-742f-4470-a3cf-a73687aaf81b" released by "delete_volume" :: held 0.978s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created reservations ['e4f3e938-6c8e-438a-b74b-bc08d0d068b4', 'c2345d07-4da6-49ce-ab0c-774c055b303e', '83d21ea4-bf8a-4ca3-a0e0-c5df7358cd06', '45e2dec4-ae39-4360-8357-4a78eaecf866'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:53 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:53 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:53 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-quobyte-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf16503-5afb-4d05-8d04-ccd1085f14b8]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:54 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82" returned: 0 in 0.520s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:54 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 Apr 10 13:25:54 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-8c86e0d9-6ce5-4590-9229-e45b0a84af82" released by "_copy_volume_from_snapshot" :: held 4.684s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-4619a86a-84b3-4814-8c45-511ecb8212c8-8c86e0d9-6ce5-4590-9229-e45b0a84af82" released by "_create_volume_from_snapshot" :: held 4.720s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.752s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.242s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1582972036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8fa251-c5e0-4145-b1e3-0b021f638e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:46Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Creating volume ad8fa251-c5e0-4145-b1e3-0b021f638e0e {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:54 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c816d6-ec52-4900-9b82-500c67fcbecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82', 'volume_size': 1, 'snapshot_id': '4619a86a-84b3-4814-8c45-511ecb8212c8'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:54 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e 1073741824 Apr 10 13:25:54 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e62c53a-bbd2-4170-89f4-30baab4e1546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:54 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Volume volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 (8c86e0d9-6ce5-4590-9229-e45b0a84af82): created successfully Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e62c53a-bbd2-4170-89f4-30baab4e1546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Flow 'volume_create_manager' (385ab167-15ac-465b-a3a8-33eb580e30fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:54 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-c62f6553-9066-4482-b5db-b8de0a70e621 tempest-VolumeDependencyTests-799528399 None] Created volume successfully. Apr 10 13:25:54 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.566s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:54 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Deleted volume successfully. Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad15dc51-2759-42ea-9032-7f28ca745bf9 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-7c4ac3d4-742f-4470-a3cf-a73687aaf81b-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:54 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-4619a86a-84b3-4814-8c45-511ecb8212c8-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98" returned: 0 in 0.580s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-4619a86a-84b3-4814-8c45-511ecb8212c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-quobyte-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:54 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98 Apr 10 13:25:54 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-quobyte-4619a86a-84b3-4814-8c45-511ecb8212c8" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-4619a86a-84b3-4814-8c45-511ecb8212c8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Deleting offline snapshot 4619a86a-84b3-4814-8c45-511ecb8212c8 of volume aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] snapshot_file for this snap is: volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc91f81-675a-4d22-aefe-f6a143e39ee5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:54 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 Apr 10 13:25:54 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:54 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e 1073741824" returned: 0 in 0.652s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:54 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:54 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e Apr 10 13:25:54 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:55 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98" returned: 0 in 0.600s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:55 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8" returned: 0 in 0.525s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98" released by "delete_volume" :: held 1.212s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9357e8-939f-41f8-8e73-4bdfb9858574]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created reservations ['e033bd74-0818-476c-8469-87d58d4197c7', '899c606b-8753-45d2-963e-90aea79830fd', 'c6cf8c0d-0563-4a90-8e69-cc4eb894a9df', '7cce192c-8ece-4133-b263-4facdf28f33a'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:55 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e" returned: 0 in 0.476s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:55 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f Apr 10 13:25:55 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5552bb93-8e54-4da9-87f1-c54b15bc9bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0dd8eb-3d0e-4559-b196-05ef74181e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:55 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e (ad8fa251-c5e0-4145-b1e3-0b021f638e0e): created successfully Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0dd8eb-3d0e-4559-b196-05ef74181e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:55 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:55 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (2530d454-e38e-44eb-a0f0-c0abebfc6b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:55 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1af6a41c-6cb4-4808-8000-0afaf5ff8630 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created volume successfully. Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (0255beec-afa6-4967-8dc2-a83f6e0dffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9a2e74-ac6b-4481-b838-700e8e41f536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9a2e74-ac6b-4481-b838-700e8e41f536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418902664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5200a9-55d1-4c74-9ed6-d7b3d44b3e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:56Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86278798-2873-498b-b864-65bce12f0dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86278798-2873-498b-b864-65bce12f0dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:55 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb660ac-9e49-4490-a361-1a854ff411a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb660ac-9e49-4490-a361-1a854ff411a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5200a9-55d1-4c74-9ed6-d7b3d44b3e10', 'volume_name': 'volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f16b59-d6da-4508-8274-eb498631fe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f16b59-d6da-4508-8274-eb498631fe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68673fe9-5b34-437a-9368-0744cd84b19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:55 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume af5200a9-55d1-4c74-9ed6-d7b3d44b3e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10', 'volume_size': 1} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418902664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5200a9-55d1-4c74-9ed6-d7b3d44b3e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:56Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Creating volume af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:55 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" returned: 0 in 0.651s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:55 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 1073741824 Apr 10 13:25:55 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:55 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 Apr 10 13:25:55 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:55 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:55 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (4a484795-6149-45ab-a621-7d3c81c92d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf1844a-652c-462f-a816-70fa2e1b7617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.707s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf1844a-652c-462f-a816-70fa2e1b7617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1530462018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee731e4-9383-4b21-b78e-12d91836b7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:56Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f32df1-28f8-4c5b-a04f-7d81015b1fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f32df1-28f8-4c5b-a04f-7d81015b1fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bff504c-142e-4170-8a9b-b8fc1c37c428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bff504c-142e-4170-8a9b-b8fc1c37c428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee731e4-9383-4b21-b78e-12d91836b7c4', 'volume_name': 'volume-dee731e4-9383-4b21-b78e-12d91836b7c4', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c957a2-3c34-4920-8dd3-00a32098c60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c957a2-3c34-4920-8dd3-00a32098c60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56cce0d0-8762-45b3-8ec8-e4e24aed66a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume dee731e4-9383-4b21-b78e-12d91836b7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee731e4-9383-4b21-b78e-12d91836b7c4', 'volume_size': 1} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:56 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Deleted volume successfully. Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-051dfd72-15cc-49e7-8009-55d6da290f4f tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-a8f7fe93-b7b9-46d9-9f64-8ac1edbaec98-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-99d3e8b7-2be8-4e5d-bc8e-046cd3652264-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-99d3e8b7-2be8-4e5d-bc8e-046cd3652264-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-quobyte-99d3e8b7-2be8-4e5d-bc8e-046cd3652264" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-99d3e8b7-2be8-4e5d-bc8e-046cd3652264" acquired by "delete_volume" :: waited 0.023s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa28970-15f1-4740-ae5b-9bff328da05b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (491c0c48-a610-417f-9e4b-6301daffbf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43caa74b-1d7f-4c86-a5c6-d392b98f3574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264 Apr 10 13:25:56 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43caa74b-1d7f-4c86-a5c6-d392b98f3574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256403498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be96e02-4bd9-4da1-9d22-d331e903aa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:56Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79fe1b6-0d23-45ad-bb2c-19d3dbb657a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79fe1b6-0d23-45ad-bb2c-19d3dbb657a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37829c5d-d044-4491-bcb1-f2f1f837a1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37829c5d-d044-4491-bcb1-f2f1f837a1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be96e02-4bd9-4da1-9d22-d331e903aa12', 'volume_name': 'volume-7be96e02-4bd9-4da1-9d22-d331e903aa12', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac198f42-5848-458d-b3e5-360a3418dd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac198f42-5848-458d-b3e5-360a3418dd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070f52d5-d7be-4581-818f-23c0897ba245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume 7be96e02-4bd9-4da1-9d22-d331e903aa12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be96e02-4bd9-4da1-9d22-d331e903aa12', 'volume_size': 1} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:56 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8" returned: 0 in 0.745s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:56 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8 Apr 10 13:25:56 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (62b4734d-2941-4f42-8957-d115a3456372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b8a67-3365-4c54-8a91-cd2b8bee1ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b8a67-3365-4c54-8a91-cd2b8bee1ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1292020886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3eced4-c7fb-442e-8938-a8338e04875a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:57Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174cf7b2-c8e4-47e6-b314-0cd1aa754f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174cf7b2-c8e4-47e6-b314-0cd1aa754f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5114965e-35b6-4596-8f13-4c441dca7a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5114965e-35b6-4596-8f13-4c441dca7a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3eced4-c7fb-442e-8938-a8338e04875a', 'volume_name': 'volume-8e3eced4-c7fb-442e-8938-a8338e04875a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901087ba-2ac7-46db-b2d7-ca3c4faea8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901087ba-2ac7-46db-b2d7-ca3c4faea8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04daa7ae-9063-44a6-837c-96939c5ca7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume 8e3eced4-c7fb-442e-8938-a8338e04875a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3eced4-c7fb-442e-8938-a8338e04875a', 'volume_size': 1} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (d106e3ca-f679-4a94-86b6-ba2896bcef3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:56 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38911d4c-279f-4069-99c6-7113d3370ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38911d4c-279f-4069-99c6-7113d3370ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1715336697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af364dff-85cd-460a-b81d-de51bd5bb607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:57Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd5129c-0335-4ac1-9fa9-dda86213314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd5129c-0335-4ac1-9fa9-dda86213314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daff5e3-4edc-4992-962b-9026f3bf3b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daff5e3-4edc-4992-962b-9026f3bf3b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af364dff-85cd-460a-b81d-de51bd5bb607', 'volume_name': 'volume-af364dff-85cd-460a-b81d-de51bd5bb607', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311f50e1-8c8d-413d-a9b1-2ffa06379bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311f50e1-8c8d-413d-a9b1-2ffa06379bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fb5f8b-7ed8-4589-aefd-127a10e4ce6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:56 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume af364dff-85cd-460a-b81d-de51bd5bb607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af364dff-85cd-460a-b81d-de51bd5bb607', 'volume_size': 1} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:56 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 1073741824" returned: 0 in 1.117s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:57 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 Apr 10 13:25:57 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:57 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264" returned: 0 in 0.726s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:57 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264 Apr 10 13:25:57 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:57 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f.4619a86a-84b3-4814-8c45-511ecb8212c8" returned: 0 in 0.637s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-4619a86a-84b3-4814-8c45-511ecb8212c8" released by "_delete_snapshot" :: held 2.625s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" released by "delete_snapshot" :: held 2.659s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Created reservations ['c3f41ee8-6680-48f2-89de-97339dc922d9', '608ff111-8ae1-4c25-b76e-23d242b7ba40', '1b1a1d71-42a4-4890-9760-6736df9dbc69', '49c78121-1c2a-4461-94fb-5da8d0c73eeb'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:57 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Delete snapshot completed successfully. Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-2e94937f-9d2c-432a-ae3d-f05173445bf3 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-4619a86a-84b3-4814-8c45-511ecb8212c8-delete_snapshot" released by "delete_snapshot" :: held 2.752s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:57 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10" returned: 0 in 0.478s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1530462018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee731e4-9383-4b21-b78e-12d91836b7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:56Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Creating volume dee731e4-9383-4b21-b78e-12d91836b7c4 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:57 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:57 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4 1073741824 Apr 10 13:25:57 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68673fe9-5b34-437a-9368-0744cd84b19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d6ce7f-5022-476e-bc2c-c352deeda548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:57 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 (af5200a9-55d1-4c74-9ed6-d7b3d44b3e10): created successfully Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d6ce7f-5022-476e-bc2c-c352deeda548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (0255beec-afa6-4967-8dc2-a83f6e0dffbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:57 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1e839c96-173a-46fe-9f0f-61580d45c9ca tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created volume successfully. Apr 10 13:25:57 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-99d3e8b7-2be8-4e5d-bc8e-046cd3652264" returned: 0 in 0.479s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-99d3e8b7-2be8-4e5d-bc8e-046cd3652264" released by "delete_volume" :: held 1.254s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created reservations ['0571da90-1ae8-4ffe-92a3-0b4e1590eada', '25a8c98b-73c3-4cd8-8125-b0b2485b5dc5', '0aa67e4c-2c5a-436c-b143-67e1bc438ba8', '69b72d49-7224-4d56-b406-82731c852b1f'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:57 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:57 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-aa96b3ab-8943-4c9e-af6a-1449d8807d1f-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Lock "cinder-aa96b3ab-8943-4c9e-af6a-1449d8807d1f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-quobyte-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f074fc-9815-4364-adf0-d39f4dbba1a1]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:57 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:57 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f Apr 10 13:25:57 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:58 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4 1073741824" returned: 0 in 0.552s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:58 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4 Apr 10 13:25:58 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:58 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.507s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:58 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Deleted volume successfully. Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-6e7731b0-07fa-4960-8b29-bb2f076db45b tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-99d3e8b7-2be8-4e5d-bc8e-046cd3652264-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:58 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" returned: 0 in 0.619s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:58 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f Apr 10 13:25:58 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-d2b5a5fd-9381-4dac-b81b-513cef2a1054-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:58 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4" returned: 0 in 0.487s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-d2b5a5fd-9381-4dac-b81b-513cef2a1054-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.939s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256403498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be96e02-4bd9-4da1-9d22-d331e903aa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:56Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Creating volume 7be96e02-4bd9-4da1-9d22-d331e903aa12 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:58 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:58 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12 1073741824 Apr 10 13:25:58 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-quobyte-d2b5a5fd-9381-4dac-b81b-513cef2a1054" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56cce0d0-8762-45b3-8ec8-e4e24aed66a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee731e4-9383-4b21-b78e-12d91836b7c4', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929e4536-b4b5-4461-8ad9-15a5ae23f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:58 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume volume-dee731e4-9383-4b21-b78e-12d91836b7c4 (dee731e4-9383-4b21-b78e-12d91836b7c4): created successfully Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929e4536-b4b5-4461-8ad9-15a5ae23f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (4a484795-6149-45ab-a621-7d3c81c92d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:58 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-707653c6-7649-4fa2-9d31-54c1d1aa90cd tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created volume successfully. Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-d2b5a5fd-9381-4dac-b81b-513cef2a1054" acquired by "delete_volume" :: waited 0.036s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf6aab1-9636-4517-bc44-9e6345ac13d5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:25:58 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:58 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054 Apr 10 13:25:58 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:59 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" returned: 0 in 0.503s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-aa96b3ab-8943-4c9e-af6a-1449d8807d1f" released by "delete_volume" :: held 1.161s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Created reservations ['46f5b390-5116-4e39-8aa8-05152bf7626a', '3c1ea2f7-da1d-42f7-aaf2-062fdbecac88', '1696435c-ef80-404e-b7ee-410c554e4b80', '39fb5a42-85db-48f2-9047-c11c96f0aa48'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:59 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:59 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:59 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12 1073741824" returned: 0 in 0.615s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:59 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12 Apr 10 13:25:59 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:59 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054" returned: 0 in 0.609s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:59 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054 Apr 10 13:25:59 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:59 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.518s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:25:59 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Deleted volume successfully. Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ddaf68b0-fe52-4dba-be80-4e1d713ba0ca tempest-VolumeDependencyTests-799528399 None] Lock "cinder-aa96b3ab-8943-4c9e-af6a-1449d8807d1f-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:59 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-d2b5a5fd-9381-4dac-b81b-513cef2a1054" returned: 0 in 0.499s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-d2b5a5fd-9381-4dac-b81b-513cef2a1054" released by "delete_volume" :: held 1.138s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created reservations ['4e6aa13e-a027-480b-8bf8-46a507ebc70c', '7446fcff-ae20-4bde-9a09-20def4878338', '330e8951-2d6a-4385-9033-ee7dca7a3141', '025dd117-6653-4df5-9d85-a3ac56f93f3d'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:59 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:25:59 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:25:59 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12" returned: 0 in 0.680s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.068s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1292020886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3eced4-c7fb-442e-8938-a8338e04875a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:57Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Creating volume 8e3eced4-c7fb-442e-8938-a8338e04875a {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:25:59 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070f52d5-d7be-4581-818f-23c0897ba245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be96e02-4bd9-4da1-9d22-d331e903aa12', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6723701-b336-4209-bebb-635d119368ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:25:59 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume volume-7be96e02-4bd9-4da1-9d22-d331e903aa12 (7be96e02-4bd9-4da1-9d22-d331e903aa12): created successfully Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6723701-b336-4209-bebb-635d119368ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:25:59 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (491c0c48-a610-417f-9e4b-6301daffbf8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:25:59 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-beaa6c56-1e1d-4ea1-9d4c-0e23e6b1cd75 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created volume successfully. Apr 10 13:25:59 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a 1073741824 Apr 10 13:25:59 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:26:00 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Flow 'volume_create_manager' (4f3c5402-6f8f-4556-a2a5-b525581d3617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a76d27e-ed92-4829-82ae-3f611104724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.521s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:00 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Deleted volume successfully. Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a76d27e-ed92-4829-82ae-3f611104724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1954391430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ea8e221c0f4823b92305354970ce06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:26:00Z,use_quota=True,user_id='13e66befa6a2400f8483a5b123f33265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2622521b-bc0d-4583-b2ca-b72184639714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2622521b-bc0d-4583-b2ca-b72184639714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9ce419-5897-4eb2-87e9-ab3117000018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9ce419-5897-4eb2-87e9-ab3117000018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa', 'volume_name': 'volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cd1963-8462-4e05-98a3-47b4a38f9ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cd1963-8462-4e05-98a3-47b4a38f9ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc7b54d-f80c-428f-a6dd-99941891a3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:00 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Volume 2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa', 'volume_size': 1} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-9ef3ba9d-a24e-402a-9ec6-1b9aaf92cb29 tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-d2b5a5fd-9381-4dac-b81b-513cef2a1054-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:00 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a 1073741824" returned: 0 in 0.587s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:00 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a Apr 10 13:26:00 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-c3693add-7977-4549-abdb-8b7c39d6e783-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-c3693add-7977-4549-abdb-8b7c39d6e783-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-quobyte-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-quobyte-c3693add-7977-4549-abdb-8b7c39d6e783" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-c3693add-7977-4549-abdb-8b7c39d6e783" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Deleting offline snapshot c3693add-7977-4549-abdb-8b7c39d6e783 of volume 1ff1aa31-535d-4354-b821-2bcf5fa0da2a {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] snapshot_file for this snap is: volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ae6baa-d4a8-4fbd-add3-de9ceb05d3be]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:00 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 Apr 10 13:26:00 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:00 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a" returned: 0 in 0.472s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:26:00 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.012s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1715336697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af364dff-85cd-460a-b81d-de51bd5bb607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400d95f336a9454488bfd801b070861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:25:57Z,use_quota=True,user_id='6800a176b3994b07a5fc1de223762244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Creating volume af364dff-85cd-460a-b81d-de51bd5bb607 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:26:01 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04daa7ae-9063-44a6-837c-96939c5ca7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3eced4-c7fb-442e-8938-a8338e04875a', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc16656f-58fc-47e5-a178-56da95efd8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:01 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607 1073741824 Apr 10 13:26:01 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:01 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume volume-8e3eced4-c7fb-442e-8938-a8338e04875a (8e3eced4-c7fb-442e-8938-a8338e04875a): created successfully Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc16656f-58fc-47e5-a178-56da95efd8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (62b4734d-2941-4f42-8957-d115a3456372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:26:01 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-34be4e62-db74-4c5b-890d-462cd7ebcfe7 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created volume successfully. Apr 10 13:26:01 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783" returned: 0 in 0.614s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[35438574-58f7-45f9-814d-25cec4dfa0c3]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:01 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a Apr 10 13:26:01 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:01 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607 1073741824" returned: 0 in 0.582s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:01 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:01 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607 Apr 10 13:26:01 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:02 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" returned: 0 in 0.585s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:02 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 Apr 10 13:26:02 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:02 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607" returned: 0 in 0.551s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1954391430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ea8e221c0f4823b92305354970ce06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:26:00Z,use_quota=True,user_id='13e66befa6a2400f8483a5b123f33265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Creating volume 2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:26:02 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fb5f8b-7ed8-4589-aefd-127a10e4ce6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af364dff-85cd-460a-b81d-de51bd5bb607', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:02 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa 1073741824 Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc05b6f5-6239-430a-911f-3ef0f5c7b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:02 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:02 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Volume volume-af364dff-85cd-460a-b81d-de51bd5bb607 (af364dff-85cd-460a-b81d-de51bd5bb607): created successfully Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc05b6f5-6239-430a-911f-3ef0f5c7b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Flow 'volume_create_manager' (d106e3ca-f679-4a94-86b6-ba2896bcef3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:26:02 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-7dc86d2c-d80a-4e17-bfec-7d60af4f96df tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created volume successfully. Apr 10 13:26:02 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783" returned: 0 in 0.578s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:02 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783 Apr 10 13:26:02 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:02 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa 1073741824" returned: 0 in 0.525s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:02 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:02 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa Apr 10 13:26:02 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:03 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a.c3693add-7977-4549-abdb-8b7c39d6e783" returned: 0 in 0.525s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-c3693add-7977-4549-abdb-8b7c39d6e783" released by "_delete_snapshot" :: held 2.360s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" released by "delete_snapshot" :: held 2.373s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created reservations ['92669b19-8d8a-463e-96b3-31028e043155', '59d1bf79-c178-4683-9e73-f27aa2df29e7', '49295e56-ee3e-497c-abd7-12600b9f0717', '96695d39-fca9-4b33-9563-2520582f5965'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:03 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:03 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Delete snapshot completed successfully. Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-20a61209-61e2-4900-9664-e614466eaa9e tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-c3693add-7977-4549-abdb-8b7c39d6e783-delete_snapshot" released by "delete_snapshot" :: held 2.499s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa" returned: 0 in 0.509s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc7b54d-f80c-428f-a6dd-99941891a3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fb0e4a-e29e-4ae2-b7b7-d50fccae042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:03 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Volume volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa (2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa): created successfully Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fb0e4a-e29e-4ae2-b7b7-d50fccae042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Flow 'volume_create_manager' (4f3c5402-6f8f-4556-a2a5-b525581d3617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:26:03 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-788fef58-ee68-4d8d-8cb5-030b53a11f71 tempest-VolumeDependencyTests-799528399 None] Created volume successfully. Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-af364dff-85cd-460a-b81d-de51bd5bb607-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-af364dff-85cd-460a-b81d-de51bd5bb607-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-quobyte-af364dff-85cd-460a-b81d-de51bd5bb607" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-af364dff-85cd-460a-b81d-de51bd5bb607" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0c20f6-c6a2-41bf-b925-63145d5457dc]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:03 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607 Apr 10 13:26:03 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Flow 'volume_create_manager' (55e40c31-f705-46b8-9113-2f3a171d186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97a1613-130e-4374-9cea-a7db4ea9c843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97a1613-130e-4374-9cea-a7db4ea9c843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-674892663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9527d93-bb8b-4d20-9b2d-19572570e8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ea8e221c0f4823b92305354970ce06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa,status='creating',terminated_at=None,updated_at=2026-04-10T11:26:04Z,use_quota=True,user_id='13e66befa6a2400f8483a5b123f33265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04f3445-0a68-4990-b68f-2da445ecf6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04f3445-0a68-4990-b68f-2da445ecf6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1f96f2-f9d6-401c-97e1-6abe55f25951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-1ff1aa31-535d-4354-b821-2bcf5fa0da2a-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1f96f2-f9d6-401c-97e1-6abe55f25951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f9527d93-bb8b-4d20-9b2d-19572570e8e2', 'volume_name': 'volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2', 'volume_size': 1, 'source_volid': '2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa', 'source_volstatus': 'available'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d4665b-69c8-4770-b1e0-1ae9523c9901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d4665b-69c8-4770-b1e0-1ae9523c9901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d028ff-2147-45df-8da1-36e6b98795bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:03 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Volume f9527d93-bb8b-4d20-9b2d-19572570e8e2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2', 'volume_size': 1, 'source_volid': '2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa', 'source_volstatus': 'available'} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-1ff1aa31-535d-4354-b821-2bcf5fa0da2a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:03 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Cloning volume 2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa to volume f9527d93-bb8b-4d20-9b2d-19572570e8e2 Apr 10 13:26:03 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Creating offline snapshot bd437ad0-fedc-49be-8abf-388878253d46 of volume 2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3a8bed-796b-43f5-bbba-61e5c4efeb63]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "cinder-quobyte-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" acquired by "delete_volume" :: waited 0.012s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b779fca-9828-4802-9894-181cf3040f9e]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:04 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607" returned: 0 in 0.624s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:04 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa Apr 10 13:26:04 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:04 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607 Apr 10 13:26:04 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:04 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a Apr 10 13:26:04 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:04 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa" returned: 0 in 0.581s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:04 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 1G Apr 10 13:26:04 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:04 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" returned: 0 in 0.608s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:04 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a Apr 10 13:26:04 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:04 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af364dff-85cd-460a-b81d-de51bd5bb607" returned: 0 in 0.600s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-af364dff-85cd-460a-b81d-de51bd5bb607" released by "delete_volume" :: held 1.253s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created reservations ['a3acd6c9-6f02-453c-859b-7c7d33fb65cc', '02c56435-6c98-49b2-bb04-6321d9ccd39b', 'ef622fc5-2d59-42bb-871b-015e096190ad', '982ef879-1c0f-4957-8e7a-ed2a13f0da20'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:04 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:04 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:04 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:05 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 1G" returned: 0 in 0.573s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:05 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 Apr 10 13:26:05 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:05 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" returned: 0 in 0.528s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-quobyte-1ff1aa31-535d-4354-b821-2bcf5fa0da2a" released by "delete_volume" :: held 1.167s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Created reservations ['c31434cc-0fa6-4e63-af21-bfe05cd54eb2', 'ade85bd2-d91b-4fbc-aa46-de72a365c8d4', '86e12b6e-31a4-4bc2-a9a2-71a207da3bb7', 'b7d33b11-915b-44d9-b9d8-a12820ad0ba1'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:05 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.498s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:05 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Deleted volume successfully. Apr 10 13:26:05 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:05 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8c20190a-d98f-41b3-ad1c-9bab3ba0aba1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-af364dff-85cd-460a-b81d-de51bd5bb607-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-8e3eced4-c7fb-442e-8938-a8338e04875a-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-8e3eced4-c7fb-442e-8938-a8338e04875a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-quobyte-8e3eced4-c7fb-442e-8938-a8338e04875a" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-8e3eced4-c7fb-442e-8938-a8338e04875a" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e26c605-a186-4a37-96cf-69ca688925e8]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:05 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46" returned: 0 in 0.510s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:05 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 is being set with open permissions: ugo+rw Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:05 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 Apr 10 13:26:05 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:05 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a Apr 10 13:26:05 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:05 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.535s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:05 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Deleted volume successfully. Apr 10 13:26:05 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-97aa0ab6-1c5b-4ff7-99dd-4d380271b9ce tempest-CreateVolumesFromSnapshotTest-1088936039 None] Lock "cinder-1ff1aa31-535d-4354-b821-2bcf5fa0da2a-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:06 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a" returned: 0 in 0.591s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:06 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46" returned: 0 in 0.573s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:06 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a Apr 10 13:26:06 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:06 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.info Apr 10 13:26:06 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:06 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8e3eced4-c7fb-442e-8938-a8338e04875a" returned: 0 in 0.537s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-8e3eced4-c7fb-442e-8938-a8338e04875a" released by "delete_volume" :: held 1.152s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created reservations ['0d3cb587-c706-41d5-a78b-a23131adcdaa', 'f9679de3-49fd-49e9-a47e-0c280e992cb4', 'cf1e3a56-f9bd-4651-b18f-5e538f396afb', '5b1a4ed0-4a52-4a79-9d9a-bc2c69c67d47'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:06 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.info" returned: 0 in 0.589s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:06 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.info is being set with open permissions: ugo+rw Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:06 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:06 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.info Apr 10 13:26:06 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:06 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:06 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:07 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.595s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:07 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Deleted volume successfully. Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8fe803ff-7605-47b7-8c21-b7ca4317d971 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-8e3eced4-c7fb-442e-8938-a8338e04875a-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:07 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.info" returned: 0 in 0.654s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-quobyte-f9527d93-bb8b-4d20-9b2d-19572570e8e2" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-f9527d93-bb8b-4d20-9b2d-19572570e8e2" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] snapshot: bd437ad0-fedc-49be-8abf-388878253d46, volume: f9527d93-bb8b-4d20-9b2d-19572570e8e2, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c0cae8-9d57-4267-a405-56054df39579]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:07 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 Apr 10 13:26:07 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-7be96e02-4bd9-4da1-9d22-d331e903aa12-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-7be96e02-4bd9-4da1-9d22-d331e903aa12-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-quobyte-7be96e02-4bd9-4da1-9d22-d331e903aa12" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-7be96e02-4bd9-4da1-9d22-d331e903aa12" acquired by "delete_volume" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33714a2-7cca-4b97-bd7d-c07e0b8a2f63]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:07 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:07 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12 Apr 10 13:26:07 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:08 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46" returned: 0 in 0.571s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10e7f64-eddc-4331-9549-02bc2028befc]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:08 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa Apr 10 13:26:08 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:08 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12" returned: 0 in 0.612s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:08 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12 Apr 10 13:26:08 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:08 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa" returned: 0 in 0.617s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:26:08 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:08 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 Apr 10 13:26:08 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:09 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-7be96e02-4bd9-4da1-9d22-d331e903aa12" returned: 0 in 0.527s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-7be96e02-4bd9-4da1-9d22-d331e903aa12" released by "delete_volume" :: held 1.163s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created reservations ['52b2e314-a644-4e2c-9dbf-33f0f172d955', 'af7384a2-f9ee-4e9b-be37-0bbb61e59147', '25ff56ab-11ea-47fc-b585-569d1135feeb', '057f6d09-c2bd-4e2e-9b1d-f96cec75df80'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:09 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:09 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:09 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.717s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:09 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Deleted volume successfully. Apr 10 13:26:09 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-a5ace561-b650-4893-99b1-f4ad83861d47 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-7be96e02-4bd9-4da1-9d22-d331e903aa12-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-dee731e4-9383-4b21-b78e-12d91836b7c4-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-dee731e4-9383-4b21-b78e-12d91836b7c4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-quobyte-dee731e4-9383-4b21-b78e-12d91836b7c4" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:10 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-dee731e4-9383-4b21-b78e-12d91836b7c4" acquired by "delete_volume" :: waited 0.035s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:10 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc7eb56-0536-4154-a462-0b96118ca5ce]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:10 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:10 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4 Apr 10 13:26:10 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:11 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2" returned: 0 in 2.473s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[8598bb32-7436-4f27-920b-a40f26555cd0]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:11 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4" returned: 0 in 1.051s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:11 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4 Apr 10 13:26:11 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:11 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa Apr 10 13:26:11 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:11 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-dee731e4-9383-4b21-b78e-12d91836b7c4" returned: 0 in 0.470s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-dee731e4-9383-4b21-b78e-12d91836b7c4" released by "delete_volume" :: held 1.592s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created reservations ['57c41314-3b6f-4d97-9105-33805d8aaf22', 'e76638a0-839a-4c29-84f6-dea52c694335', '5e390765-b11e-4aa8-bb03-f759c678d325', 'b6713383-2fad-4d2a-a99c-4a82519aeab4'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:11 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:11 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:11 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa" returned: 0 in 0.720s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:26:11 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Converted 1024.00 MB image at 413.76 MB/s Apr 10 13:26:11 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 is being set with open permissions: ugo+rw Apr 10 13:26:11 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:11 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 Apr 10 13:26:11 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:12 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.571s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:12 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Deleted volume successfully. Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-quobyte-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-03d42f19-0a92-4550-8db7-fb2f3361d5e1 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-dee731e4-9383-4b21-b78e-12d91836b7c4-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10" acquired by "delete_volume" :: waited 0.020s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8004bc-63dc-4cd0-9212-8911c3900460]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:12 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2" returned: 0 in 0.623s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-f9527d93-bb8b-4d20-9b2d-19572570e8e2" released by "_copy_volume_from_snapshot" :: held 5.070s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-quobyte-bd437ad0-fedc-49be-8abf-388878253d46" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-bd437ad0-fedc-49be-8abf-388878253d46" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Deleting offline snapshot bd437ad0-fedc-49be-8abf-388878253d46 of volume 2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] snapshot_file for this snap is: volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4f23aa-d9c2-449b-b3ac-90dff0e950b8]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:12 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:12 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 Apr 10 13:26:12 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:12 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 Apr 10 13:26:12 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:13 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10" returned: 0 in 0.546s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:13 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10 Apr 10 13:26:13 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:13 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46" returned: 0 in 0.521s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bfd58b-4382-4321-97b8-fe7756c2202b]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Flow 'volume_create_manager' (62e4fdb9-b2d8-4c67-8969-57d24d746359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4cd5af-106a-42c8-be33-fb9f5e08d2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4cd5af-106a-42c8-be33-fb9f5e08d2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1855105449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c67690-de4d-44b1-a59b-e8067de53a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6ba97d704045b4beaf954862f74632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:26:13Z,use_quota=True,user_id='981f00332cbc453289237830df31028d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69eb3dd2-714b-4e41-ab5c-b0eff89d9de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69eb3dd2-714b-4e41-ab5c-b0eff89d9de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea9f96b-d183-4070-95e1-dc5a8e347279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea9f96b-d183-4070-95e1-dc5a8e347279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c67690-de4d-44b1-a59b-e8067de53a44', 'volume_name': 'volume-97c67690-de4d-44b1-a59b-e8067de53a44', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2aef29-ea2c-4bde-8dd8-7fb7d612a5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:13 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa Apr 10 13:26:13 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2aef29-ea2c-4bde-8dd8-7fb7d612a5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e81da6-98a3-4cd2-bdcc-575b433f7f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:13 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Volume 97c67690-de4d-44b1-a59b-e8067de53a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c67690-de4d-44b1-a59b-e8067de53a44', 'volume_size': 1} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:13 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10" returned: 0 in 0.448s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10" released by "delete_volume" :: held 1.058s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created reservations ['477ea764-56de-46ae-be91-a557d5b4420b', 'fbc22862-cd50-4ae2-b263-442760be7768', '58340fff-d317-407a-a7a0-0761cf418af3', 'c92b4fb1-9a20-4520-8423-3eb6d99f5524'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:13 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:13 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:13 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa" returned: 0 in 0.490s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:13 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:13 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 Apr 10 13:26:13 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:14 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.420s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:14 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Deleted volume successfully. Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-8ebbe204-ce05-41be-9700-10498255f6d0 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-af5200a9-55d1-4c74-9ed6-d7b3d44b3e10-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:14 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46" returned: 0 in 0.457s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:14 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46 Apr 10 13:26:14 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-ad8fa251-c5e0-4145-b1e3-0b021f638e0e-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:14 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa.bd437ad0-fedc-49be-8abf-388878253d46" returned: 0 in 0.420s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-bd437ad0-fedc-49be-8abf-388878253d46" released by "_delete_snapshot" :: held 1.957s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-ad8fa251-c5e0-4145-b1e3-0b021f638e0e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "cinder-quobyte-ad8fa251-c5e0-4145-b1e3-0b021f638e0e" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.670s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.354s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1855105449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c67690-de4d-44b1-a59b-e8067de53a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6ba97d704045b4beaf954862f74632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:26:13Z,use_quota=True,user_id='981f00332cbc453289237830df31028d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)}" {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Creating volume 97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:26:14 devstack cinder-volume[82554]: INFO cinder.volume.drivers.remotefs [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] casted to osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 1073741824 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d028ff-2147-45df-8da1-36e6b98795bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2', 'volume_size': 1, 'source_volid': '2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa', 'source_volstatus': 'available'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fae3c5-7047-42ef-b9e6-053f70060e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:14 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 1073741824 Apr 10 13:26:14 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-ad8fa251-c5e0-4145-b1e3-0b021f638e0e" acquired by "delete_volume" :: waited 0.045s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd813be-76d8-4578-98fc-05a4b03edd93]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:14 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Volume volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 (f9527d93-bb8b-4d20-9b2d-19572570e8e2): created successfully Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fae3c5-7047-42ef-b9e6-053f70060e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:14 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Flow 'volume_create_manager' (55e40c31-f705-46b8-9113-2f3a171d186e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:26:14 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-07074b55-6fa4-46b0-bc1c-b2f017fd04c7 tempest-VolumeDependencyTests-799528399 None] Created volume successfully. Apr 10 13:26:14 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e Apr 10 13:26:14 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:15 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 1073741824" returned: 0 in 0.483s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:15 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 Apr 10 13:26:15 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:15 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e" returned: 0 in 0.483s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:15 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e Apr 10 13:26:15 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:15 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44" returned: 0 in 0.441s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'} {{(pid=82554) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e81da6-98a3-4cd2-bdcc-575b433f7f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c67690-de4d-44b1-a59b-e8067de53a44', 'volume_size': 1}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23414b0e-93c4-4aca-9006-df324ec786b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-quobyte-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:15 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-ad8fa251-c5e0-4145-b1e3-0b021f638e0e" returned: 0 in 0.447s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:15 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Volume volume-97c67690-de4d-44b1-a59b-e8067de53a44 (97c67690-de4d-44b1-a59b-e8067de53a44): created successfully Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23414b0e-93c4-4aca-9006-df324ec786b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Flow 'volume_create_manager' (62e4fdb9-b2d8-4c67-8969-57d24d746359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-quobyte-ad8fa251-c5e0-4145-b1e3-0b021f638e0e" released by "delete_volume" :: held 0.962s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa" acquired by "delete_volume" :: waited 0.024s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c2e7ec-c20d-465a-b7d3-c437785bec0a]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:15 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-f2785e17-5e50-4f70-a937-84e381fee048 tempest-SnapshotDependencyTests-680393826 None] Created volume successfully. Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Created reservations ['af573e6c-566c-461a-8ef8-6c945ebb8c5c', 'ef370828-eabf-4323-8fd1-419c61ae7228', '8f4cc433-44a7-4262-a912-af0fbd5e5450', '1f1e543b-7cb1-4022-b67a-23442bf13e9b'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:15 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa Apr 10 13:26:15 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:15 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:15 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:15 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:16 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa" returned: 0 in 0.490s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:16 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa Apr 10 13:26:16 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:16 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.458s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:16 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Deleted volume successfully. Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-07758b0d-30f1-43d3-85d6-28aa49878e83 tempest-CreateVolumesFromSourceVolumeTest-302579446 None] Lock "cinder-ad8fa251-c5e0-4145-b1e3-0b021f638e0e-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Creating offline snapshot cfa9fa07-a948-4177-9325-439b9e6f2655 of volume 97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[48499a4b-e152-47e8-99cb-1a396169a435]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:16 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa" returned: 0 in 0.445s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa" released by "delete_volume" :: held 0.963s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:16 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 Apr 10 13:26:16 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Created reservations ['9a1458c1-8310-4411-bf5f-9ef5606e26c3', 'ef9893a4-61d3-4ca3-b556-c8c5d8dbb75c', '4b2e188d-b14c-4945-99ab-5951d7b20978', '91042e82-2345-4b73-8881-46b1cf37bc8c'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:16 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:16 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:16 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:17 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44" returned: 0 in 0.617s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 1G {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:17 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 1G Apr 10 13:26:17 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:17 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.538s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:17 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Deleted volume successfully. Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-0f6f3247-126a-4403-900f-bb8b0085ef07 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-2ffd1f99-ceb1-4811-a56f-0b6e03f7f7fa-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:17 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 1G" returned: 0 in 0.563s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c67690-de4d-44b1-a59b-e8067de53a44 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:17 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c67690-de4d-44b1-a59b-e8067de53a44 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 Apr 10 13:26:17 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-f9527d93-bb8b-4d20-9b2d-19572570e8e2-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-f9527d93-bb8b-4d20-9b2d-19572570e8e2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-quobyte-f9527d93-bb8b-4d20-9b2d-19572570e8e2" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-f9527d93-bb8b-4d20-9b2d-19572570e8e2" acquired by "delete_volume" :: waited 0.017s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[9702346f-960c-4a18-9afb-5bec91e8b3b6]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:17 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:17 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 Apr 10 13:26:17 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:18 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97c67690-de4d-44b1-a59b-e8067de53a44 -F qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655" returned: 0 in 0.468s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:18 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 is being set with open permissions: ugo+rw Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:18 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 Apr 10 13:26:18 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:18 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2" returned: 0 in 0.464s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:18 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2 Apr 10 13:26:18 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:18 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655" returned: 0 in 0.425s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:18 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.info Apr 10 13:26:18 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:18 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-f9527d93-bb8b-4d20-9b2d-19572570e8e2" returned: 0 in 0.410s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-f9527d93-bb8b-4d20-9b2d-19572570e8e2" released by "delete_volume" :: held 0.894s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Created reservations ['453f4394-fa49-494d-8c1a-8c06c3573c27', 'ed9318b5-cb19-4a89-9bc0-2d83c247b757', 'edcafefa-c838-4077-bcfa-420070bd10d6', 'c131e189-ce3f-4424-ae93-c44b35dcf19a'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:18 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:18 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-8c86e0d9-6ce5-4590-9229-e45b0a84af82-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:18 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Lock "cinder-8c86e0d9-6ce5-4590-9229-e45b0a84af82-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Acquiring lock "cinder-quobyte-8c86e0d9-6ce5-4590-9229-e45b0a84af82" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-8c86e0d9-6ce5-4590-9229-e45b0a84af82" acquired by "delete_volume" :: waited 0.021s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef56e0cc-0ec7-4f82-8d41-8dc434c03f52]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:19 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.info" returned: 0 in 0.457s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:19 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.info is being set with open permissions: ugo+rw Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.info {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:19 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.info Apr 10 13:26:19 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:19 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 Apr 10 13:26:19 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:19 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.460s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:19 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Deleted volume successfully. Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-62241c64-6108-4ed7-80b5-fa26b1729443 tempest-VolumeDependencyTests-799528399 None] Lock "cinder-f9527d93-bb8b-4d20-9b2d-19572570e8e2-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:19 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.info" returned: 0 in 0.408s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.991s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:19 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-860fc32d-7b25-4155-8e35-320a99705bfe tempest-SnapshotDependencyTests-680393826 None] Create snapshot completed successfully Apr 10 13:26:19 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82" returned: 0 in 0.491s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:19 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82 Apr 10 13:26:19 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82554) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Flow 'volume_create_manager' (7375eba8-851b-41f5-a1d3-c1ce8e359953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b81c55-563d-4e1d-9a20-8976f0963dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b81c55-563d-4e1d-9a20-8976f0963dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T11:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab35e15-9e2a-4fb2-937d-1c2253823d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6ba97d704045b4beaf954862f74632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T11:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cfa9fa07-a948-4177-9325-439b9e6f2655,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T11:26:20Z,use_quota=True,user_id='981f00332cbc453289237830df31028d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29902154-9a0b-4c0a-8ebe-a610173ace26),volume_type_id=29902154-9a0b-4c0a-8ebe-a610173ace26)' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a12f666-29cc-4e2b-ac57-db53e2ae1e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a12f666-29cc-4e2b-ac57-db53e2ae1e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:19 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e969d2b-8695-40a6-87cd-27f31e081788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e969d2b-8695-40a6-87cd-27f31e081788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ab35e15-9e2a-4fb2-937d-1c2253823d35', 'volume_name': 'volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35', 'volume_size': 1, 'snapshot_id': 'cfa9fa07-a948-4177-9325-439b9e6f2655'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db55d3a-4fb2-40d2-9ffb-9a6c23958b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db55d3a-4fb2-40d2-9ffb-9a6c23958b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d5c54e-5ee1-4734-bb8e-0732e23f399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:20 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Volume 2ab35e15-9e2a-4fb2-937d-1c2253823d35: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35', 'volume_size': 1, 'snapshot_id': 'cfa9fa07-a948-4177-9325-439b9e6f2655'} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "cinder-quobyte-cfa9fa07-a948-4177-9325-439b9e6f2655-2ab35e15-9e2a-4fb2-937d-1c2253823d35" by "_create_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:20 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-8c86e0d9-6ce5-4590-9229-e45b0a84af82" returned: 0 in 0.469s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Lock "cinder-quobyte-8c86e0d9-6ce5-4590-9229-e45b0a84af82" released by "delete_volume" :: held 0.981s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-cfa9fa07-a948-4177-9325-439b9e6f2655-2ab35e15-9e2a-4fb2-937d-1c2253823d35" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Creating volume 2ab35e15-9e2a-4fb2-937d-1c2253823d35 from snapshot cfa9fa07-a948-4177-9325-439b9e6f2655 {{(pid=82554) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Selected osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539 as target Quobyte volume. {{(pid=82554) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "cinder-quobyte-2ab35e15-9e2a-4fb2-937d-1c2253823d35" by "_copy_volume_from_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-2ab35e15-9e2a-4fb2-937d-1c2253823d35" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] snapshot: cfa9fa07-a948-4177-9325-439b9e6f2655, volume: 2ab35e15-9e2a-4fb2-937d-1c2253823d35, {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2c873f-6e5c-46a7-834c-485fd3c1f0da]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Created reservations ['a21655e3-8338-4724-bcfa-fe111aafbcab', 'd1fc65b8-ed9e-43e1-919d-e04b91f97713', 'cb6daeb9-69d2-4995-b88c-4c55a8b948da', '83eb636e-ee06-43ac-b479-07985861bd90'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:20 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 Apr 10 13:26:20 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:20 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:20 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:20 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.411s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:20 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Deleted volume successfully. Apr 10 13:26:20 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655" returned: 0 in 0.508s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c67690-de4d-44b1-a59b-e8067de53a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Creating direct copy from snapshot {{(pid=82554) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-1bc67ad1-79ec-437c-8b15-3f6744abfbda tempest-VolumeDependencyTests-799528399 None] Lock "cinder-8c86e0d9-6ce5-4590-9229-e45b0a84af82-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2516eb5-4bf9-4566-8d2f-8972c87b4846]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:20 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:20 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 Apr 10 13:26:20 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:21 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44" returned: 0 in 0.470s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:21 devstack cinder-volume[82554]: DEBUG cinder.utils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Path /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 not found in is_blk_device check {{(pid=82554) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 13:26:21 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:21 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 Apr 10 13:26:21 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:22 devstack cinder-volume[82554]: DEBUG oslo_service.periodic_task [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82554) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 13:26:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:22 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:22 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:22 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:22 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:23 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.598s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:23 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-df91fb38-a06e-482b-9ec1-b8e6c2174152 None None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:23 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35" returned: 0 in 2.180s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:23 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d851b85-6516-4a70-8ef8-61998159eb9f]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:23 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 Apr 10 13:26:23 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:23 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44" returned: 0 in 0.585s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:23 devstack cinder-volume[82554]: DEBUG cinder.image.image_utils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Image conversion details: src /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 {{(pid=82554) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 13:26:23 devstack cinder-volume[82554]: INFO cinder.image.image_utils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Converted 1024.00 MB image at 469.42 MB/s Apr 10 13:26:23 devstack cinder-volume[82554]: WARNING cinder.volume.drivers.remotefs [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 is being set with open permissions: ugo+rw Apr 10 13:26:23 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:23 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 Apr 10 13:26:23 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:24 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35" returned: 0 in 0.427s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-2ab35e15-9e2a-4fb2-937d-1c2253823d35" released by "_copy_volume_from_snapshot" :: held 4.226s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:24 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-cfa9fa07-a948-4177-9325-439b9e6f2655-2ab35e15-9e2a-4fb2-937d-1c2253823d35" released by "_create_volume_from_snapshot" :: held 4.246s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:24 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.260s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:24 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d5c54e-5ee1-4734-bb8e-0732e23f399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35', 'volume_size': 1, 'snapshot_id': 'cfa9fa07-a948-4177-9325-439b9e6f2655'}' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:24 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34efbca4-da34-4a22-a51b-084611b92422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 13:26:24 devstack cinder-volume[82554]: INFO cinder.volume.flows.manager.create_volume [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Volume volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 (2ab35e15-9e2a-4fb2-937d-1c2253823d35): created successfully Apr 10 13:26:24 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34efbca4-da34-4a22-a51b-084611b92422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82554) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 13:26:24 devstack cinder-volume[82554]: DEBUG cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Flow 'volume_create_manager' (7375eba8-851b-41f5-a1d3-c1ce8e359953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82554) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 13:26:24 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-ad6887be-aff3-440b-8eb1-4f91797ef64f tempest-SnapshotDependencyTests-680393826 None] Created volume successfully. Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "cinder-cfa9fa07-a948-4177-9325-439b9e6f2655-delete_snapshot" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-cfa9fa07-a948-4177-9325-439b9e6f2655-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "cinder-quobyte-97c67690-de4d-44b1-a59b-e8067de53a44" by "delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-97c67690-de4d-44b1-a59b-e8067de53a44" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "cinder-quobyte-cfa9fa07-a948-4177-9325-439b9e6f2655" by "_delete_snapshot" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-cfa9fa07-a948-4177-9325-439b9e6f2655" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Deleting offline snapshot cfa9fa07-a948-4177-9325-439b9e6f2655 of volume 97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] snapshot_file for this snap is: volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 {{(pid=82554) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4731220-7eb6-479d-b197-03c780b1e59f]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:25 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 Apr 10 13:26:25 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:25 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655" returned: 0 in 0.476s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.remotefs [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97c67690-de4d-44b1-a59b-e8067de53a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82554) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf44a4b-64eb-4266-909a-adc6ee7e6493]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:25 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:25 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 Apr 10 13:26:25 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:26 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44" returned: 0 in 0.458s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:26 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 Apr 10 13:26:26 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:26 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655" returned: 0 in 0.452s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:26 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:26 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655 Apr 10 13:26:26 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:27 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44.cfa9fa07-a948-4177-9325-439b9e6f2655" returned: 0 in 0.405s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:UPDATE=282,cinder:SELECT=204,cinder:INSERT=73,cinder:DELETE=28 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=197,cinder:UPDATE=280,cinder:DELETE=24,cinder:INSERT=60 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-cfa9fa07-a948-4177-9325-439b9e6f2655" released by "_delete_snapshot" :: held 1.851s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-97c67690-de4d-44b1-a59b-e8067de53a44" released by "delete_snapshot" :: held 1.863s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Created reservations ['ce6977d2-94b8-4df3-85c8-effd3748ece6', 'be238f1d-1306-4a06-a4ec-0ac4646ba136', '50bb335a-1ee5-4602-bebc-8664740ae58c', 'cccd3241-28cb-4c98-afea-3e34aa90ae7f'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:27 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Delete snapshot completed successfully. Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-86345fa5-0a34-470a-82d0-5687c7c3b7fb tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-cfa9fa07-a948-4177-9325-439b9e6f2655-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "cinder-97c67690-de4d-44b1-a59b-e8067de53a44-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-97c67690-de4d-44b1-a59b-e8067de53a44-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "cinder-quobyte-97c67690-de4d-44b1-a59b-e8067de53a44" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-97c67690-de4d-44b1-a59b-e8067de53a44" acquired by "delete_volume" :: waited 0.008s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[211a3695-73c5-4c05-9102-bf7045f4a068]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:27 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:27 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 Apr 10 13:26:27 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:28 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44" returned: 0 in 0.488s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:28 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44 Apr 10 13:26:28 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:28 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-97c67690-de4d-44b1-a59b-e8067de53a44" returned: 0 in 0.403s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-97c67690-de4d-44b1-a59b-e8067de53a44" released by "delete_volume" :: held 0.919s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Created reservations ['0820bddb-add9-4777-9067-e1f5330052d2', '3b8c35ba-3b45-4a33-800b-36274193be6a', '30a5d4fd-e957-405c-b033-3b82090a8ca1', '23e82d53-b2c6-42a0-9e7d-040bc61e9322'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:28 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:28 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "cinder-2ab35e15-9e2a-4fb2-937d-1c2253823d35-delete_volume" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-2ab35e15-9e2a-4fb2-937d-1c2253823d35-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "cinder-quobyte-2ab35e15-9e2a-4fb2-937d-1c2253823d35" by "delete_volume" {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-2ab35e15-9e2a-4fb2-937d-1c2253823d35" acquired by "delete_volume" :: waited 0.011s {{(pid=82554) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG oslo.privsep.daemon [-] privsep: reply[55da088c-1ae0-4602-93dd-21ca44abd3a5]: (4, 'qcow2') {{(pid=83337) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:28 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 Apr 10 13:26:28 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:28 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.443s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:28 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Deleted volume successfully. Apr 10 13:26:28 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c47d84a-98a0-4836-9ff1-9f66a557e81b tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-97c67690-de4d-44b1-a59b-e8067de53a44-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:29 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35" returned: 0 in 0.471s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:29 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35 Apr 10 13:26:29 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:29 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c/volume-2ab35e15-9e2a-4fb2-937d-1c2253823d35" returned: 0 in 0.413s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-quobyte-2ab35e15-9e2a-4fb2-937d-1c2253823d35" released by "delete_volume" :: held 0.915s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG cinder.quota [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Created reservations ['e03cc319-41a1-423b-b895-f973e67d24f0', '44fa0f35-5332-4015-8278-2e6e30e352c6', '937e56a8-5cd4-4655-90c9-4f9de243c266', '33380e37-6dd9-43c2-a371-7f6febe26b48'] {{(pid=82554) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539': None} {{(pid=82554) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG cinder.volume.drivers.quobyte [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-87b0c354-b7a6-487c-b772-4b5dca8ce539'] {{(pid=82554) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.lockutils [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82554) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 13:26:29 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 13:26:29 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c Apr 10 13:26:29 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 13:26:30 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Apr 10 13:26:30 devstack cinder-volume[82554]: DEBUG oslo_concurrency.processutils [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/93e382a2a5e07ce4bff20765fbee116c" returned: 0 in 0.466s {{(pid=82554) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 13:26:30 devstack cinder-volume[82554]: DEBUG cinder.manager [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Notifying Schedulers of capabilities ... {{(pid=82554) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 13:26:30 devstack cinder-volume[82554]: INFO cinder.volume.manager [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Deleted volume successfully. Apr 10 13:26:30 devstack cinder-volume[82554]: DEBUG cinder.coordination [None req-5c6f90aa-0c0b-4197-9edb-bda7f1ea9aef tempest-SnapshotDependencyTests-680393826 None] Lock "cinder-2ab35e15-9e2a-4fb2-937d-1c2253823d35-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=82554) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 13:26:39 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=14,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 13:26:40 devstack cinder-volume[82554]: DEBUG dbcounter [-] [82554] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=82554) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}